1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Advice for site scraping

Discussion in 'Hire a Freelancer' started by dupree1, Sep 13, 2009.

  1. dupree1

    dupree1 Newbie

    Joined:
    Jun 29, 2007
    Messages:
    7
    Likes Received:
    0
    There is a site that I am looking to scrape +100K files from. Accessing the site is free but requires registration.

    In order to prevent bots, they put up captchas every 15 or so files.

    They also ban IP addresses if the usage looks patterned.

    I want the files - not a script to get the files, just the files. Any recommendations.

    I was thinking GetAFreelancer would be an option, but how should that be implemented? Have GAF users do them in 1000 file blocks or something?

    How much should I expect to pay?
     
  2. TheMadBlackHatter

    TheMadBlackHatter Newbie

    Joined:
    Aug 7, 2009
    Messages:
    38
    Likes Received:
    47
    Occupation:
    Self-employed
    Location:
    The web
    I can get the files for you. I've sent you a PM.