Saturday, 14 September 2013

wget: reading from a list with id numbers and urls

wget: reading from a list with id numbers and urls

In a .txt file, I have 500 lines containing an id number and a website
homepage URL, in the following way
id_345 http://www.example1.com
id_367 http://www.example2.org
...
id_10452 http://www.example3.net
Using wget and the -i option, I am trying to download recursively part of
these websites, but I would like to store the files in a way that is
linked with the id number (storing the files in a directory called like
the id number, or - the best option, but i think the most difficult to
achieve - storing the html content in a single txt file called like the id
number) . Unfortunataly, the option -i cannot read a file like the one
that i am using. How can link the websites content with their connected
id?
Thanks

No comments:

Post a Comment