[clue-tech] Website Mirroring Software

[Shawn Perry]

I don't want it to go wandering to other sites, and I want to be able
to filter the html files it grabs by url.

On Tue, Sep 22, 2009 at 11:56 AM, Angelo Bertolli
<angelo.bertolli at gmail.com> wrote:
> chris fedde wrote:
>> On Tue, Sep 22, 2009 at 10:04 AM, Greg Knaddison
>> <greg.knaddison at gmail.com> wrote:
>>> On Tue, Sep 22, 2009 at 9:55 AM, Shawn Perry <redmop924 at comcast.net> wrote:
>>>> Does anyone know of a good piece of software to mirror a website and
>>>> make it locally browse-able with the ability to limit how far it
>>>> travels to?
>>> I've used "wget --mirror" in the past.  From the man page:
>>>
>>
>> I'll second the recommendation to use wget.  But remember that it will
>> get a static copy of the website.
>> all dynamic content will be captured in static views.
>
> The way you limit depth is with -l, and there are other options to
> indicate whether or not you want to cross over to other sites, etc.  I
> usually just use something like `wget -crl 2 URL`  -c is a good option
> to use.
>
> Angelo
> _______________________________________________
> clue-tech mailing list
> clue-tech at cluedenver.org
> http://www.cluedenver.org/mailman/listinfo/clue-tech
>