Website Mirroring With wget

Wget has some more advanced features then shown here, which are worth noting in case you ever have a need for them.  These include:

1. Support for cookie handling – in the event that a site you are mirroring requires cookies, or uses cookies for certain features to work properly. 
2. Support for proxy servers – this can reduce network traffic, and provide greater speed for some downloads. 
3. Wgetrc – you can use this file to store often used wget commands and settings.  Wget will read this file upon startup.
4. Simple spidering – this feature will check that a page is available – without downloading it.  This is useful for monitoring a page, or to check a list of pages to see which still exist (link list or bookmarks, etc.)
5. Quotas – you can specify a maximum to download during a recursive download. 
6. HTTP user / password – If you are downloading a password protected site, you can pass along access information to wget. 

Wrap Up

These examples cover some of the basic uses for the program.  Spend some time reading through all the options available to get a better handle on its full capabilities.  However, even if you only use the options I have demonstrated here, I think you will agree that this is quite a handy tool to keep around.