[ dmg . research . theArchivist ] edit

An application for archiving or "sucking" web sites, this tool starts with a single URL and works its way out from there. Be careful with your stoppping rules or it'll put the whole web on your hard disk!

You limit the crawl, or archive, scope by limiting the number of hops, the servers crawled, etc.
    theArchivist

last updated 3.20.2009 by Brian R Johnson