[Chugalug] spiderring a site question

Rod rod-lists at epbfi.com
Sun Nov 3 17:23:01 UTC 2013


I'm thinking of mirroring a site that is about to shutdown. But first I  
want to determine what kind of storage I need.
My normal tool is wget. But I don't see a way to gauge file/site size  
without downloading. Any ideas on how spider a site and determine file  
size without downloading?

-- 
Using Opera's mail client: http://www.opera.com/mail/


More information about the Chugalug mailing list