Automated Downloading with Wget

Abstract

Wget is a useful program, run through your computer’s command line, for retrieving online material. It can be useful in the following situations: Retrieving or mirroring (creating an exact copy of) an entire website. This website might contain historical documents, or it may simply be your own personal website that you want to back up. One command can download the entire site onto your computer. Downloading specific files in a website’s hierarchy (all websites within a certain part of a website, such as every page that is contained within the /papers/ directory of a website).

Keywords

• Wget
• web scraping
• downloading