[clue-talk] Mirroring a web site?

Roy Johnston rjohnston at denverinternet.com
Wed May 17 09:29:09 MDT 2006


On Tue, 16 May 2006 18:54:13
Jed spoke thusly...



On Tue, 16 May 2006 17:51:45 -0600
Sean LeBlanc wrote:

> Let's suppose you wanted to capture a site locally for reading offline
> or when you can't reach the site. What sort of tools are there to do
> this?

wget

-- 


If you want a mirror of a specific page: 
wget example.com/sample.html

If you want to get all of a web site - just one level deep (the direct links from index) use: 
wget example.com

If you actually do want to grab a mirror of the whole site - use: 
wget --mirror example.com

be aware - that you can get more than you expect
also, it is considered rude to grab a full mirror during business hours - unless you know that they have plenty of bandwidth.

...roy



More information about the clue-talk mailing list