41.7 Wget Multiple Files Repeatedly
20210211
This script will download a collection of PDF
documents, continuing from where we got up to previously if the
process was interrupted and so only downloading files that have
changed on the server (-c
), placing the downloaded files
into the a specific folder (-P
), and identifying the agent
as a browser (-U
):
for f in 4925 4844 4761 4737 4704; do
wget -c -P downloads \
-U "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)" \
$f.pdf;
https://example.com/pdf/done
Your donation will support ongoing availability and give you access to the PDF version of this book. Desktop Survival Guides include Data Science, GNU/Linux, and MLHub. Books available on Amazon include Data Mining with Rattle and Essentials of Data Science. Popular open source software includes rattle, wajig, and mlhub. Hosted by Togaware, a pioneer of free and open source software since 1984. Copyright © 1995-2022 Graham.Williams@togaware.com Creative Commons Attribution-ShareAlike 4.0
