1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Archive.org / wayback machine scraper

Discussion in 'Hire a Freelancer' started by xiphre, Dec 12, 2013.

  1. xiphre

    xiphre Regular Member

    Joined:
    Jun 9, 2007
    Messages:
    290
    Likes Received:
    84
    Location:
    EU
    Hi!

    Looking for someone who can make a simple archive.org site scraper in php(yes, php/curl - nothing else please). Needed functions in a nutshell:

    1. Form where you enter the url, f.ex:

    https://web.archive.org/web/20090228184644/http://www.blackhatworld.com/

    Thus we would want all files in the 2009 02 28 cache.

    2. The script first returns the amount of files that will be downloaded, hence you may decide whether or not to proceed with the download.

    3. Files are downloaded - progress meter "x out of y files downloaded" is displayed.

    4. When done the whole site will be presented in a zip file. The zip file should hold an error log of all files that were not successfully scraped.

    Payment with Paypal and platonic xmas love. Send me a PM with price and contact information.
     
  2. thisismymp3

    thisismymp3 Power Member

    Joined:
    Jan 6, 2010
    Messages:
    762
    Likes Received:
    290
    yo i have been wanting this for a while myself..let me know when you get it
     
  3. rutix

    rutix Junior Member

    Joined:
    Sep 6, 2012
    Messages:
    102
    Likes Received:
    12
    i can do it, pm sent.
     
  4. mindmaster

    mindmaster Jr. VIP Jr. VIP Premium Member

    Joined:
    Sep 16, 2010
    Messages:
    2,501
    Likes Received:
    1,135
    Location:
    at my new office
    Interested in this as well.
    OP if you want to share costs of the bot we can JV on this.

    Cheers
     
  5. Gorroblanco

    Gorroblanco Newbie

    Joined:
    Feb 18, 2011
    Messages:
    22
    Likes Received:
    1
    Definitely still interested in this. Shoot me a PM with price.
     
  6. mofoparrot

    mofoparrot Junior Member

    Joined:
    Jan 2, 2011
    Messages:
    130
    Likes Received:
    24