how much time should it wait for next query for google?

F

flyingbear

Junior Member

Mar 7, 2011

195

19

• Dec 16, 2011

• #1

Hi,

I'm scraping google. for one ip, how much time should I wait for then go to the next query, so that G will not block the ip? 60 seconds? or more? any optimized time interval?


thanks

 

Initial Effort

Elite Member

Oct 29, 2010

1,958

279

• Dec 16, 2011

• #2

Are you scraping search results, images or something else? This will depend on your wait time.

 

BHopkins

Elite Member

Dec 31, 2010

2,609

1,753

• Dec 16, 2011

• #3

Are you talking about how long to scrape each page? Are you scraping manually or using something like ScrapeBox?

 

ILoveCSharp

Regular Member

Nov 2, 2011

368

45

• Dec 17, 2011

• #4

i say wait 30 sec. think as normal human behaviour

 

F

flyingbear

Junior Member

Mar 7, 2011

195

19

• Dec 17, 2011
• Thread Starter Thread Starter

• #5

BHopkins said:

Are you talking about how long to scrape each page? Are you scraping manually or using something like ScrapeBox?

Click to expand...

I'm having developer to mak a program which scrape google.when scrape different pages, I guess it should pause some time for a ip, correct?

 

El_Seo

Regular Member

May 24, 2009

276

54

• Dec 17, 2011

• #6

a random wait time between 10 and 15 seconds should be enough. you can increase it to 15-30 second if you get captcha but 10-15 should be enough.

 

V

VaPaperChaser

BANNED

Sep 23, 2009

101

18

• Dec 17, 2011

• #7

Yes, You are right EL_seo

Thanks,