Experienced coder for Google scraping bot

V

VikingAds

BANNED

Mar 16, 2009

858

448

• Nov 2, 2015

• #1

Hello,

I'm looking for an experienced coder to put together a bot that will be able to scrape from Google.

I don't have any preference regarding coding language, as long as the program runs fast and is bug free.

Multi threading, proxy and captcha support will be required.

Full details can be sent on request. Please only apply if you can start within a reasonable timeframe

Thank you

 

Chris22

Regular Member

Sep 29, 2010

400

1,069

• Nov 2, 2015

• #2

Why do you require multi threading when network tasks are IO bound and not CPU bound?

 

D

Deleted member 209614

Guest

• Nov 2, 2015

• #3

I can create within 48 hour

pm sent

 

V

VikingAds

BANNED

Mar 16, 2009

858

448

• Nov 2, 2015
• Thread Starter Thread Starter

• #4

Chris22 said:

Why do you require multi threading when network tasks are IO bound and not CPU bound?

Click to expand...

I'm not sure on the exact terms, but I would like the bot to run multiple instances of scraping at the same time using different proxies. I thought this was referred to as multi threading

seopencil said:

I can create within 48 hour

pm sent

Click to expand...

Replied to PM, thank you

 

MrBlue

Senior Member

Dec 18, 2009

975

695

• Nov 2, 2015

• #5

I've already written an asynchronous Google serp scraper with proxy support in Node.js. Hit me up on Skype: i_m_mrblue

 

sam.hunt0710

Elite Member

Executive VIP

Jr. VIP

Jan 8, 2010

13,623

8,249

• Nov 2, 2015

• #6

Our devs have already coded a very powerful google scraper, you can run 100-200 threads per box and scrape million records per day.

Do check our reviews from BHW members

http://www.blackhatworld.com/blackh...ream-programmer-your-dream-project-today.html

 

V

VikingAds

BANNED

Mar 16, 2009

858

448

• Nov 6, 2015
• Thread Starter Thread Starter

• #7

Still opened to proposals on this

 

handmadebots

Senior Member

Nov 8, 2012

1,072

255

• Nov 6, 2015

• #8

You won't be able to get this easily.
There are two ways to do it, first one the normal way, using a browser, getting blocked, typing catcha, etc... The second way would be using their API, but that's paid.
The best option would be using their API (there is no free version, it was before, but now only paid) but I'm not sure if they allow multiple threads/requests at the same time.

Good luck !

 

J

jordank90

Newbie

Dec 8, 2014

34

2

• Nov 6, 2015

• #9

You do realise scrapebox already scrapes google and has lately just had a big update adding loads of features. Scrapebox is NOT just a blog commenter. It can do basically anything including building white hat links, scraping lists of sites, contact details. The only limit with scrapebox is your creativity.

 

V

VikingAds

BANNED

Mar 16, 2009

858

448

• Nov 6, 2015
• Thread Starter Thread Starter

• #10

jordank90 said:

You do realise scrapebox already scrapes google and has lately just had a big update adding loads of features. Scrapebox is NOT just a blog commenter. It can do basically anything including building white hat links, scraping lists of sites, contact details. The only limit with scrapebox is your creativity.

Click to expand...

Hi,

Yes i do know what scrapebox does i have been using that for a long time now. However it does not do at all what i need for this project. The description i gave is vague, however if anyone is interested in working with me on this i will give detailed description. Thanks