MikeyMikey13
BANNED
- May 25, 2014
- 2,340
- 1,024
Saw a few threads regarding how to scrape/rebuild archive.org sites, so I thought I would post my method and the script I use for rebuilding the sites.
SORRY FOR ALL TEXT
(It isn't my script, but i'll show you how to use it.)
What you'll need:
1. Install Ruby and run CMD in Ruby
2. Unpack the scripts on your machine
3. Locate the scripts with CMD (e.g "cd desktop/wayback" for me)
4. Load up archive.org, put your site in and find the version you want to download
5. Find the timestamp you need (http://i.imgur.com/uNzPQ8p.png)
6. Now run the following command "wayback_machine_downloader (URL) --to (timestamp)"
An example of this is: "wayback_machine_downloader http://www.amazon.com --to 20020125100220"
7. Wait for the script to finish, you will get a message in CMD once it is complete.
8. Go to (wayback folder)>websites>(URL of archive site)
Simple, right?
Full list of commands here: https://github.com/hartator/wayback-machine-downloader
TIP: with the command to download the site, you can use both "to" or "from". I get the best results usually from doing "to". This 99% of the time downloads the timestamp you want. If it can not download the timestamp you want, it will do the one from before.
SORRY FOR ALL TEXT
(It isn't my script, but i'll show you how to use it.)
What you'll need:
- Ruby (https://rubyinstaller.org/)
- https://github.com/hartator/wayback-machine-downloader
1. Install Ruby and run CMD in Ruby
2. Unpack the scripts on your machine
3. Locate the scripts with CMD (e.g "cd desktop/wayback" for me)
4. Load up archive.org, put your site in and find the version you want to download
5. Find the timestamp you need (http://i.imgur.com/uNzPQ8p.png)
6. Now run the following command "wayback_machine_downloader (URL) --to (timestamp)"
An example of this is: "wayback_machine_downloader http://www.amazon.com --to 20020125100220"
7. Wait for the script to finish, you will get a message in CMD once it is complete.
8. Go to (wayback folder)>websites>(URL of archive site)
Simple, right?
Full list of commands here: https://github.com/hartator/wayback-machine-downloader
TIP: with the command to download the site, you can use both "to" or "from". I get the best results usually from doing "to". This 99% of the time downloads the timestamp you want. If it can not download the timestamp you want, it will do the one from before.
Last edited:
