[CLUE-Tech] Downloading multiple web pages
Kevin Cullis
kevincu at orci.com
Sun Apr 29 10:11:49 MDT 2001
Lynn Danielson wrote:
>
> Kevin Cullis wrote:
> >
> > I'd like to download a complete web site's info without having to do it
> > individually for each web page. How would I go about this?
>
> Kevin, check out wget. I've not used it myself, but I believe it will
> do what you want.
Found this on LDPs site:
> > >FYI, I use wget+tidy+xslt to do this (well, the prototype script that is,
> > >as the final version will be in Narval as described in LG#59), so any
> >
> > I usually do such scripts in wget+sed+awk (+perl when I need it) - KISS
>
> I KISS a lot and you wouldn't believe how stupid and simple such a script
> can get using wget+tidy+xslt compared to what it'd be using
> wget+{sed,awk,perl,python} !
>
I'll have to check these out as well. The combination might be just the
thing I'm looking for.
Kevin
More information about the clue-tech
mailing list