weruncompanies
Power Member
- Feb 15, 2011
- 605
- 287
Purchased and ordered proxies... Awaiting proxies to work. Thanks!
Permanently Closed Marketplace Sales Thread
- Thread starter Sweetfunny
- Start date
- Status
- Jan 25, 2009
- 6,378
- 3,774
If you have the automator you could do the PR one by just putting the job in there like 3 times, but it won't work with the competition finder, atm.
However I simply use private proxies for my PR checking and do it with the 1:5 connection
roxy ratio and 99% of the time it completes with all results the first time. I have a vid here if you need more info:
Slow down, turn your connections down. See the video above.
Last edited by a moderator:
myfault
Senior Member
- Sep 21, 2012
- 970
- 242
If you have the automator you could do the PR one by just putting the job in there like 3 times, but it won't work with the competition finder, atm.
However I simply use private proxies for my PR checking and do it with the 1:5 connection
I have a vid here if you need more info:
Slow down, turn your connections down. See the video above.
Yeah i have 10 proxies and set the connection to 1, should i use "article dashboard" footprint, can you advice me please.
Last edited by a moderator:
HelloInsomnia
Elite Member
- Mar 1, 2009
- 1,801
- 3,042
What kind of proxies? Public, shared, private? I think that will help enlighten everyone. That footprint isn't anything too crazy so on private proxies from a good source I am sure Looplines recommendations are spot on - however, it really depends on your proxies.
myfault
Senior Member
- Sep 21, 2012
- 970
- 242
It is private proxies which i bought from sslprivateproxy.com. I just seen after 40 minutes of scrapping google again blocked the IP, using only 1 connection.
HelloInsomnia
Elite Member
- Mar 1, 2009
- 1,801
- 3,042
It is private proxies which i bought from sslprivateproxy.com. I just seen after 40 minutes of scrapping google again blocked the IP, using only 1 connection.
Since you are using one connection you can also untick the "use multithreaded harvester" under settings and then set a delay - maybe 5 seconds - and see if you get better results.
myfault
Senior Member
- Sep 21, 2012
- 970
- 242
If i don't use multithread option than scrapping takes forever. How you guys doing ?
HelloInsomnia
Elite Member
- Mar 1, 2009
- 1,801
- 3,042
But it's just one connection so it shouldn't make a difference - other than the delay time that is. You may need more proxies or a different proxy source. Also, that footprint should work with other engines - you may find more luck there.
myfault
Senior Member
- Sep 21, 2012
- 970
- 242
Don't know but this problem was started last month and regarding proxy providers i tried newipnow and that also banned in the few minutes. Is there any issue in footprints, if yes what to avoid ?
anguschkong
Junior Member
- Jun 6, 2013
- 111
- 13
just bought the tool and waiting for the activation...cant wait!
- Jul 13, 2008
- 2,219
- 5,431
Under the Settings menu there's an option "Adjust Pagerank lookup retries" and you can increase it to 20 retries, so each failed URL it will try again up to 20 times with another proxy. You could even shut SB down, and open the scrapebox.ini using Notepad and find ProxyRetries=20 under the [PageRank] heading and change it to an even higher number manually.
This should help a lot. As for the Competition Checker addon, retries could be added for a future version.
The first thing to try is revert your blogs theme back to the default, and disable all Wordpress plugins. Then post an article, if it works the culprit is your theme or plugins, re-enable one at a time and make a post each time until you find exactly which one.
HelloInsomnia
Elite Member
- Mar 1, 2009
- 1,801
- 3,042
No. But you're using one thread so there's no need to use the multithreaded harvester.. As for footprints you should be fine with that. It's a pretty simple formula really - if your proxies are getting banned then it's going to fast and in your case just slowing it down a little bit will help or purchasing ten more proxies if you need it to go faster.
myfault
Senior Member
- Sep 21, 2012
- 970
- 242
I think sweeetfunny should make this feature.
I am using single thread and it is 8 hrs gone still it is working. May be try to buy more 10 private proxies. Should i buy shared proxies so i can get the combination of both private and shared ?
HelloInsomnia
Elite Member
- Mar 1, 2009
- 1,801
- 3,042
Private will always be best. But ask your provider if they have shared that will work for Google scraping. They might be able to set you up with people who are using it for other things instead.
pethum
Regular Member
- May 3, 2010
- 439
- 38
Defacult theme and no plugins activated. But still showing text as "???????????"
- Jan 25, 2009
- 6,378
- 3,774
As HelloInsomnia said, its pointless to have a delay in a multi threaded harvester, just turn the connections down. In your case using 1 connection in the multi threaded harvester vs using the single threaded harvester is the EXACT same thing.
They delay he mentioned is the best way to go. Google has different kinds of IP bans, so they ban quicker for some queries then others, so you are probably using one that gets banned more quickly. About a month ago they tightened things down and ban ips more frequently now then they used to, which is when your saying this happened. Especially if your having the same issue with other providers.
So in short, don't over think it. Your just going to fast. So you either have to up the delay, or increase the number of proxies that you are using, thats all there is to it.
This video on ip bans may be useful for you
http://www.youtube.com/watch?v=P9CbGhfc1aY
- Jan 25, 2009
- 6,378
- 3,774
Its working now, it was down for just a short while. It seems they had some intermittent issues there.
http://stats.pingdom.com/vz0wm9714wj5/322551
- Status