Home arrow Web Services arrow Website Mirroring With wget
WEB SERVICES

Website Mirroring With wget


Have you ever wanted to copy a Website for offline browsing or backup purposes? There’s a powerful UNIX tool called wget that can do this, and much more. I’ll review a simple example of using this tool, and discuss some advanced features that are huge timesavers. GNU wget is a free utility which runs under UNIX and Windows. In a nutshell, this program can go out and effectively mirror a Website for local browsing or backup purposes. While it has more powerful features, this article will focus on the basics of the tool. 

Author Info:
By: Jim Roberts
Rating: 5 stars5 stars5 stars5 stars5 stars / 77
February 04, 2004
TABLE OF CONTENTS:
  1. · Website Mirroring With wget
  2. · Using wget
  3. · Other Notable Features

print this article
SEARCH DEVARTICLES

Website Mirroring With wget
(Page 1 of 3 )

Why wget?

There are countless ways to copy your Website.  Many Website editors actually keep a local copy of the site for you.  So, why should you bother with wget?  Well, there are several advantages to this utility.  It’s free, easy to learn, and runs from the command line.  The last of these is important, because it makes wget easy to automate through “cron” or “at” jobs.  Overall, I find it’s a useful utility to have in my toolbox – fast, powerful, and easy to use.

Obtaining and Installing wget

First, we’ll need to install the software.  For Linux users, it may already be there – just type “which wget” at your shell prompt to see if you have it. 

Windows users can get a ported binary here:

http://xoomer.virgilio.it/hherold/

Look for the latest binary, and be sure to download the ssllibs as well (These enable retrieval of https web pages).  I downloaded wget 1.9.1 and ssllibs 0.97.  I copied all the files to my C:\Program Files\wget directory.  If you choose, add this to your system path for easy use. 


blog comments powered by Disqus
WEB SERVICES ARTICLES

- Dealing with Loose Coupling in a Service-Ori...
- Loose Coupling in a Service-Oriented Archite...
- Safety, Idempotence, and the Resource-Orient...
- The Resource-Oriented Architecture in Action
- Features of the Resource-Oriented Architectu...
- The Resource-Oriented Architecture
- Getting Started with Flex
- Automated Billing and Faxing for the Web
- An Introduction to Web Services
- The Foundations of Web Services: From Novice...
- Web Services Reengineering: Finishing Touches
- Fault Handling with Web Services
- Flow and Web Services
- Process Lifecycles and Web Services
- Business Processes and Web Services

Watch our Tech Videos 
Dev Articles Forums 
 RSS  Articles
 RSS  Forums
 RSS  All Feeds
Write For Us 
Weekly Newsletter
 
Developer Updates  
Free Website Content 
Contact Us 
Site Map 
Privacy Policy 
Support 

Developer Shed Affiliates

 




© 2003-2017 by Developer Shed. All rights reserved. DS Cluster - Follow our Sitemap
Popular Web Development Topics
All Web Development Tutorials