[Scrapebox] G Block Harvesting Even With Proxies

[tiagorossi]

Hello.

I'm having an issue when harvesting G with Scrapebox, even when I change IP address or use proxies G still blocks my harvest requests.

Please, anyone got that issue before and know how to avoid this?

Thank you very much.

 

[tazarbm]

depends on how many queries you're doing per second / per proxy there are some time-related settings you need to play with, but I don't remember which ones...

@loopline might know... or you can ask in the SB thread:

https://www.blackhatworld.com/seo/s...auto-blog-commenter-with-prstorm-mode.129096/

 

[tiagorossi]

depends on how many queries you're doing per second / per proxy there are some time-related settings you need to play with, but I don't remember which ones...

@loopline might know... or you can ask in the SB thread:

https://www.blackhatworld.com/seo/s...auto-blog-commenter-with-prstorm-mode.129096/

Got it, when I harvest for the 1st time of the day it works then after the 1st block no more harvests for that day...

I'll try with queries per second configuration, I was at no limit...

 

[tazarbm]

Got it, when I harvest for the 1st time of the day it works then after the 1st block no more harvests for that day...

I'll try with queries per second configuration, I was at no limit...

it looks like google is blocking your IP / proxies. Google are very sensitive to scraping / harvesting, which is why you need to increase the timeout between proxy usage, especially if you use few proxies (less than 10) but do a lot of scraping

By the way, have you watched loopline's tutorials?? Because the guy explains most of this stuff in those clips quite well, so I recommend taking a few days to go through all of them if you wish to get the hang of SB. Here's the link to his tutorials:

https://www.youtube.com/@looplinescrapebox/videos

 

[tiagorossi]

it looks like google is blocking your IP / proxies. Google are very sensitive to scraping / harvesting, which is why you need to increase the timeout between proxy usage, especially if you use few proxies (less than 10) but do a lot of scraping

By the way, have you watched loopline's tutorials?? Because the guy explains most of this stuff in those clips quite well, so I recommend taking a few days to go through all of them if you wish to get the hang of SB. Here's the link to his tutorials:

https://www.youtube.com/@looplinescrapebox/videos

Hey tazarbm I really appreciate your help! For sure I'll start watching those videos today.

 

[710fla]

You need rotating proxies that change at every IP request to scrape Google or a bunch of private proxies and use the Detailed Harvester with a delay.

Other engines like Bing don't have as tight security so easier to scrape just so you know.

 

[tiagorossi]

You need rotating proxies that change at every IP request to scrape Google or a bunch of private proxies and use the Detailed Harvester with a delay.

Other engines like Bing don't have as tight security so easier to scrape just so you know.

Thank you very much, that's it. I'll use simple queries to scrape because I'm changing the local internet IP address instead of using proxies.

 

[loopline]

yeah its about speed. IF you scrape too many results in too short a time you get banned. So you can slow down, or you can add/change ips. Thats the only 2 options.

 

[AskeetRealz]

yeah its about speed. IF you scrape too many results in too short a time you get banned. So you can slow down, or you can add/change ips. Thats the only 2 options.

Hi mate. @loopline Apparently my 25 proxies are banned by Google. tell me, if this happened, should I change proxies to new ones or wait a while and try again, but with a longer delay?

 

[Steptoe]

Hi mate. @loopline Apparently my 25 proxies are banned by Google. tell me, if this happened, should I change proxies to new ones or wait a while and try again, but with a longer delay?

I would really not bother trying to scrape Google with private proxies. Your best bet is a service that will rotate residential proxies on every request (check the BHW marketplace) or a service that provides bulk scraped public proxies semi-regularly (this sort of service is harder to find nowadays). If you really want to use your private proxies to scrape, use the detailed harvester, and use a delay of 30-60 seconds. (and yes, you'll want to request a refresh of your current burned proxies from your proxy provider)

 

[tiagorossi]

I would really not bother trying to scrape Google with private proxies. Your best bet is a service that will rotate residential proxies on every request (check the BHW marketplace) or a service that provides bulk scraped public proxies semi-regularly (this sort of service is harder to find nowadays). If you really want to use your private proxies to scrape, use the detailed harvester, and use a delay of 30-60 seconds. (and yes, you'll want to request a refresh of your current burned proxies from your proxy provider)

Thank you very much for your input, that information: "detaliled harvester with 30 - 60 seconds" will be used for sure!

yeah its about speed. IF you scrape too many results in too short a time you get banned. So you can slow down, or you can add/change ips. Thats the only 2 options.

Thank for all your support and for your amazing software! Congratulations.

 

[tiagorossi]

Hi mate. @loopline Apparently my 25 proxies are banned by Google. tell me, if this happened, should I change proxies to new ones or wait a while and try again, but with a longer delay?

I think you need both, change proxies and also use more delay. Check out the Youtube channel from loopline about Scrapebox and you will find gold there.

 

[AskeetRealz]

I think you need both, change proxies and also use more delay. Check out the Youtube channel from loopline about Scrapebox and you will find gold there.

Thank u. Looks like u know the things. Can u please explain me what exactly settings i need to set for safety scraping. For example. I would like to use the Alexa Rank Cheker. But i always get this 429 Error when scraping without proxies. With proxies i am getting just "Error Blocked". I dont know where to go : (

 

[AskeetRealz]

Thank u. Looks like u know the things. Can u please explain me what exactly settings i need to set for safety scraping. For example. I would like to use the Alexa Rank Cheker. But i always get this 429 Error when scraping without proxies. With proxies i am getting just "Error Blocked". I dont know where to go : (

I mean... there is even no description of that 429 Error code... When testing proxies - they are all good and passing. In Alexa Addon i have Connections 50 and Timeout is 30000. Whats up?

 

[tiagorossi]

I mean... there is even no description of that 429 Error code... When testing proxies - they are all good and passing. In Alexa Addon i have Connections 50 and Timeout is 30000. Whats up?

I really dont know what's going on, maybe Alexa blocked the proxies IP addresses, for how long time you're doing this?

 

[seoguysdotae]

Hello, is this thread active? Would like to ask a few questions. I am using rotating residential proxies and its working okay not great as in not getting huge lists for URL. Does anyone have any updated footprint list ? Also suggestions on proxies ? Private proxies don't work . Also i have GSA proxy scraper, does that work well with scrapebox ?,