Do you guys scrape google alot these days?

satyr85 · Jun 15, 2023

Hey guys,

I'm wondering if google scraping is still hot topic these days. I'm working on google scraping proxy service, but I'm not sure if there is demand for such service. Maybe I'm focusing on wrong niche...

Most of google scraping proxy services died because of multiple google anti-scraping updates, so there is nearly no competition on market, but maybe there is also nearly no demand?

Nikolaos · Jun 17, 2023

I don't know about demand but what you're trying to do basically is very difficult.

ristoriel · Jun 17, 2023

Google has made it very difficult by taking many anti-scraping measures such as IP blocking, captchas and rate limits. So, there is not any reliable tool or service available that can handle these challenges and provide accurate data. That's why, no one is even talking about it. You can focus on something else that involves proxies.

proxygo · Jun 18, 2023

satyr85 said:
Hey guys,

I'm wondering if google scraping is still hot topic these days. I'm working on google scraping proxy service, but I'm not sure if there is demand for such service. Maybe I'm focusing on wrong niche...

Most of google scraping proxy services died because of multiple google anti-scraping updates, so there is nearly no competition on market, but maybe there is also nearly no demand?

i think in terms of cost compared to years ago
ide say its probably not as popular as it was

satyr85 · Jun 18, 2023

ristoriel said:
there is not any reliable tool or service available that can handle these challenges and provide accurate data

Valueserp, serpapi, serper.dev and few similar. There are reliable services on market, but these are pretty expensive.

airwolf137 · Jun 18, 2023

why not use scrapebox with proxies?

nohupt · Jun 18, 2023

satyr85 said:
Hey guys,

I'm wondering if google scraping is still hot topic these days. I'm working on google scraping proxy service, but I'm not sure if there is demand for such service. Maybe I'm focusing on wrong niche...

Most of google scraping proxy services died because of multiple google anti-scraping updates, so there is nearly no competition on market, but maybe there is also nearly no demand?

my guess is that most people in our industry have the skills to do it themselves. and scraping a webpage is pretty darn easy in any language, but nodejs is the best in my experience.

Gants-P · Jun 18, 2023

There's ways to scrape you just need a Google in house IP, but given what happens when you tell people things it becomes oversaturated.

As one person here said: "if it's of value it's hidden from site, yet if it's not it's oversaturated and outdated yet profitable from those with no eyes"

All I can say is, python is your friend(and open AI have scraped everything sites including Reddit are on protest)but if for educational purposes go for it.

satyr85 · Jun 19, 2023

i think in terms of cost compared to years ago

Years ago bunch of public proxies did the job

Good old times

airwolf137 said:
why not use scrapebox with proxies?

Do you know any good proxies for google scraping that dont charge per GB? I've looked for these and didnt found anything with reliable pricing and good speeds.

and scraping a webpage is pretty darn easy in any language, but nodejs is the best in my experience.

Processing scraped content it easy as 2+2. Its about getting google search result page without getting bans doing 100's thousands or milions requests a day.

turelink · Jun 21, 2023

Lots of scraping API or Serp API now...

king of google scraper should be is, https://www.perplexity.ai/

Do you guys scrape google alot these days?

satyr85

Elite Member

Nikolaos

Elite Member

ristoriel

Banned - Multiple Rules Violations

proxygo

Elite Member

satyr85

Elite Member

airwolf137

Regular Member

nohupt

Power Member

Gants-P

BANNED

satyr85

Elite Member

turelink

Elite Member

Main Menu

Marketplace

Making Money

BlackHat World