Scrapebox - URLs/s?

O

Olbol

Junior Member

Jul 22, 2010

126

24

• Nov 4, 2010

• #1

Hey all,

I was wondering if everyone can say what sort of speed they're getting with Google URL harvester. I'm having trouble getting over 300 URLS/s (20MB line).

I seem to remember that I used to be able to get a lot better than this.

Would be nice to get a gauge of what other people are getting, and if there is anything I might be missing.

 

bilbo

Power Member

Jan 26, 2009

649

1,151

• Nov 4, 2010

• #2

your averaging 300 a sec - that a great speed

 

gregstereo

Elite Member

Jr. VIP

Oct 5, 2009

2,342

1,197

• Nov 4, 2010

• #3

Seconded, 300/sec is rock solid, we always want more faster, but do the math there....that's 18000 per minute, or over a milion in an hour...

You could double-check you're using the multi threaded harvester but I have the strangest feeling you are lol...I'm on 20MBPS line also and usually get between 80 and 160 per second. I'd vote for being happy with what you have.

 

O

Olbol

Junior Member

Jul 22, 2010

126

24

• Nov 4, 2010
• Thread Starter Thread Starter

• #4

Look like I'm doing alright then, I do filter down the proxies to be less than 3,000ms and quite a quick timeout for the harvester. If I run 2 sessions of SB with half of the keywords in each, the URLs/s literally doubles to 550-600 URLs/s. Weird or what?

 

MaxTucker

BANNED

Aug 22, 2010

423

334

• Nov 4, 2010

• #5

on private proxies with multithreading on max and a 50mbit internet connection I hit 800 p/s once but average is 650 p/s

 

D

dowellgeorge5

Newbie

Nov 2, 2010

28

1

• Nov 4, 2010

• #6

Wow MaxTucker whose are you using?

 

S

SNB321

Regular Member

Apr 29, 2012

240

14

• Dec 14, 2013

• #7

for me it's 650 p/s