Developing a Keyword Tool

rayi

Senior Member

Jul 27, 2022

1,115

240

• Aug 12, 2022

• #1

We are currently developing a keyword suggest tool, we are getting the keywords from google suggest queries and we got good results.
Currently, we are facing the issue - like google blocking the IP address after using it continuously.

How can we solve this issue? Experts any suggestions?

 

tazarbm

Elite Member

Executive VIP

Jr. VIP

Oct 28, 2020

11,663

14,635

• Aug 12, 2022

• #2

proxies

 

itz_styx

Elite Member

Jr. Executive VIP

Jr. VIP

May 8, 2012

4,217

3,728

• Aug 12, 2022

• #3

there are many already for google suggest.
if you don't want to get banned, as like with anything else - use proxies.

 

Monsterer

Elite Member

Jr. VIP

Nov 26, 2015

4,748

1,049

• Aug 12, 2022

• #4

Use any other IP VPN or proxies so you can't get this issue

 

V

vickreal

Newbie

Jun 17, 2022

12

1

• Aug 12, 2022

• #5

rayi said:

We are currently developing a keyword suggest tool, we are getting the keywords from google suggest queries and we got good results.
Currently, we are facing the issue - like google blocking the IP address after using it continuously.

How can we solve this issue? Experts any suggestions?

View attachment 221272

Click to expand...

name of tool?

 

Pragesh.Diol

Junior Member

Jan 7, 2022

100

24

• Aug 12, 2022

• #6

PROXIES CALLING HERE.
OR
Best solution would be rotating proxies.

 

rayi

Senior Member

Jul 27, 2022

1,115

240

• Aug 12, 2022
• Thread Starter Thread Starter

• #7

tazarbm said:

proxies

Click to expand...

itz_styx said:

there are many already for google suggest.
if you don't want to get banned, as like with anything else - use proxies.

Click to expand...

Okay, I understand. We are developing tool like Answer the public. For example, if 1000 users using the tool at a time, do we have to use 1000 proxies?

Any ideas on how they develop the tool coding background?

Any suggestions?

 

itz_styx

Elite Member

Jr. Executive VIP

Jr. VIP

May 8, 2012

4,217

3,728

• Aug 12, 2022

• #8

yes if 1000 users use it at the same time you need at least 1000 proxies, but this doesnt make sense.
in your case i would use rotating proxies, there are providers that give you a different IP for each request.
the tool coding is different, it can be done in any language. i did my google suggest scraper in C# for example.

 

HustleTong

Elite Member

May 30, 2019

13,466

10,661

• Aug 12, 2022

• #9

If you're scraping data from the PAA tab, SEO Minion already does that (fully automated)

 

blackbeans

Elite Member

Nov 29, 2008

9,247

4,807

• Aug 19, 2022

• #10

I believe that if you use software that uses the TOR or The Onion Router system, you may be able to get around this.

Because Tor is a powerful anonymity tool and by definition, the IP address keeps changing.

Of course, you also have to make sure that you automate clearing your cookies and cache along with the IP changes as you scrape Google for results.

 

Algo

Elite Member

Jr. VIP

Mar 27, 2020

1,653

667

• Aug 19, 2022

• #11

You can use services like RocketScrape or ScraperApi.

I think RocketScrape is available on Appsumo as a lifetime deal.