--------------------------------------------------- SlashCache TODO Last Updated: 12/17/2002 Author: Jared Benedict --------------------------------------------------- - Write delete script. Need to write a script to delete the stories that reach a certain age. Ideally the cached page is replaced with a forward to the original page. (This is almost done.) - Write comment submission code. Some day, the idea is to have a comment automatically submitted to the slashdot story. The comment will include links to the mirrored page. This may be more work than it's worth as slashcode is written specifically to prevent scripts from submitting comments. - An exception list for sites and specific urls which shouldn't be mirrored - Look into better mirroring technique. Currently using httrack. A mirror script which could intelligently mirror sublinks for pages which have multiple pages (ie. page 1, page 2, etc) - Abstract database connection code from functions. - Clean up and further develop web site. Prettier display of cached pages. - Add heading to cached pages that say that the page is cached, a link to the original page, and says when the cached page will be deleted. - I think some poorly formed urls screw up httrack. This may cause a problem of the work status not being set back to 0. - Look more into cookies for getting pages which require logins. (NY Times) - index.html file isn't created when a non-html document is mirrored. - don't mirror ad images so page owner can still get ad revenue. - links are currently only cached one at a time. We'd be more likely to get the page cached before it's slashdotted it they were cached in parallel.