Honestly, do you really need 1000 urls per second?
But anyway, are all your threads, timeout, proxy settings the same?
Ironically, mine has improved. Earlier, I had a 512k connection, and did an occasional 8 URLs/s.
Now, with a 2mbit connection, I get ~50 per sec.
My connections are set to 40 for each SE, for more than that, SB throttles.
Maybe, you should try by scraping each SE individually.
TheMatrix
40?!
I have 100mbit connection and 15 connections gives me the best results.
Well, I actually meant that I'm on a 1 gbps line shared amongst several users.
TheMatrix
what country do you live in and how much does a 1gbps line cost?