1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Experienced coder for Google scraping bot

Discussion in 'Hire a Freelancer' started by Adlad, Nov 2, 2015.

  1. Adlad

    Adlad Jr. VIP Jr. VIP

    Joined:
    Mar 16, 2009
    Messages:
    731
    Likes Received:
    368
    Hello,

    I'm looking for an experienced coder to put together a bot that will be able to scrape from Google.

    I don't have any preference regarding coding language, as long as the program runs fast and is bug free.

    Multi threading, proxy and captcha support will be required.

    Full details can be sent on request. Please only apply if you can start within a reasonable timeframe

    Thank you
     
  2. Chris22

    Chris22 Regular Member

    Joined:
    Sep 29, 2010
    Messages:
    400
    Likes Received:
    1,062
    Why do you require multi threading when network tasks are IO bound and not CPU bound?
     
  3. seopencil

    seopencil Supreme Member

    Joined:
    Aug 3, 2011
    Messages:
    1,491
    Likes Received:
    532
    Location:
    BHW
    Home Page:
    I can create within 48 hour

    pm sent
     
    • Thanks Thanks x 1
  4. Adlad

    Adlad Jr. VIP Jr. VIP

    Joined:
    Mar 16, 2009
    Messages:
    731
    Likes Received:
    368
    I'm not sure on the exact terms, but I would like the bot to run multiple instances of scraping at the same time using different proxies. I thought this was referred to as multi threading

    Replied to PM, thank you
     
  5. MrBlue

    MrBlue Senior Member

    Joined:
    Dec 18, 2009
    Messages:
    974
    Likes Received:
    680
    Occupation:
    Web/Bot Developer
    I've already written an asynchronous Google serp scraper with proxy support in Node.js. Hit me up on Skype: i_m_mrblue
     
  6. indianbill007

    indianbill007 Jr. VIP Jr. VIP

    Joined:
    Jan 8, 2010
    Messages:
    5,169
    Likes Received:
    4,173
    Occupation:
    Making Money when the world is sleeping
    Location:
    Menlo Park - Next to Zuck
    • Thanks Thanks x 1
  7. Adlad

    Adlad Jr. VIP Jr. VIP

    Joined:
    Mar 16, 2009
    Messages:
    731
    Likes Received:
    368
    Still opened to proposals on this :)
     
  8. handmadebots

    handmadebots Senior Member

    Joined:
    Nov 8, 2012
    Messages:
    962
    Likes Received:
    217
    Home Page:
    You won't be able to get this easily.
    There are two ways to do it, first one the normal way, using a browser, getting blocked, typing catcha, etc... The second way would be using their API, but that's paid.
    The best option would be using their API (there is no free version, it was before, but now only paid) but I'm not sure if they allow multiple threads/requests at the same time.

    Good luck !
     
  9. jordank90

    jordank90 Newbie

    Joined:
    Dec 8, 2014
    Messages:
    34
    Likes Received:
    2
    Occupation:
    Website designer/Internet marketer
    Location:
    United Kingdom
    You do realise scrapebox already scrapes google and has lately just had a big update adding loads of features. Scrapebox is NOT just a blog commenter. It can do basically anything including building white hat links, scraping lists of sites, contact details. The only limit with scrapebox is your creativity.
     
  10. Adlad

    Adlad Jr. VIP Jr. VIP

    Joined:
    Mar 16, 2009
    Messages:
    731
    Likes Received:
    368
    Hi,

    Yes i do know what scrapebox does i have been using that for a long time now. However it does not do at all what i need for this project. The description i gave is vague, however if anyone is interested in working with me on this i will give detailed description. Thanks