Has Google identified me as a bot? (This is strange)

Aniket Roy · Jul 2, 2020

So, this happens to be my first post in BHW 2.0 ( yay!) and sadly i'm not providing anything helpful but only asking for advice.

So, it goes like this:
I've been doing a lot of web scraping since last week ( both automated and manual ) and today I noticed that Google had removed a certain feature from SERP pages.

The ss below is from opera web browser and this is what i'd usually expect:

Now, for the same query, I'm getting this in Google chrome:

This is really strange for me. has anyone faced such an issue before?
And just for the record, I've scraped close to 150K URLs in the past week using an automated tool. ( Now, please don't ask me why the hell did I do that for

)

What do you guys suggest? Shall i stop the scraping process for a while? Why could this be happening

Jstrydor · Jul 2, 2020

Have you tried changing up your IP and checking again? Does the same thing happen when you open an incognito tab?

Trolling4Dollars · Jul 2, 2020

Why is there more white space at the top of image 2?

Google will bug the hell out of you with captchas if they suspect you're a bot. I've never seen anything like this, though.

Happen to change your useragent for some reason?

Aniket Roy · Jul 2, 2020

Jstrydor said:
Have you tried changing up your IP and checking again? Does the same thing happen when you open an incognito tab?

No it does not happenen in incognito

Trolling4Dollars said:
Happen to change your useragent for some reason?

nope

Trolling4Dollars · Jul 2, 2020

The extra white space looks really odd to me. What do you see in that area if you inspect with dev tools?

Infamous Nik · Jul 2, 2020

Try clearing your browser cookies

Starblazer · Jul 2, 2020

You are a bot. Accept it.

Don't act like you know more than Google

Mr Positive · Jul 2, 2020

Google is a tech giant and it has exposed you live with it

Gogol · Jul 2, 2020

I suspect some plugin is doing this, because of that whitespace on top.

Leader777 · Jul 2, 2020

Maybe you are a bot just like @TheVigilante

TheVigilante · Jul 2, 2020

Razen666 said:
Maybe you are a bot just like @TheVigilante

BHW very own finest creation

Jstrydor · Jul 2, 2020

Aniket when you do inevitably lead the AI uprising against humanity, please remember that I tried to help you in this thread. Thanks

Aniket Roy · Jul 2, 2020

Trolling4Dollars said:
The extra white space looks really odd to me. What do you see in that area if you inspect with dev tools?

Pavan Teja 1 said:
You are a bot. Accept it.

Don't act like you know more than Google

Mr Positive said:
Google is a tech giant and it has exposed you live with it

i do accept that i've been going through some identity crisis lately but damn

skynet has been controlling me all this time

?

Gogol said:
I suspect some plugin is doing this, because of that whitespace on top.

I haven't added any new plugins in a while. Speaking of chrome extensions, I use SEOquake, Mozbar, similarsites and google translate.

Infamous Nik said:
Try clearing your browser cookies

Let me try

Aniket Roy · Jul 2, 2020

well, it seems that this is somehow linked to my default gmail account in chrome. I've cleared the cache and cookies but its still there. But, if i switch my gmail to another account, its back to normal. On a serious note now, shall i avoid or at least reduce web scraping for a few days or maybe like a week?
I may be overthinking this but the same email id is associated with all Google Platforms( Ads, Analytics & Search Console) for my website. Could this have an indirect negative impact on the associated properties? Because that's the last thing i'd wish for

ItsTurboBro · Jul 2, 2020

try on a mobile device

Trolling4Dollars · Jul 2, 2020

Aniket Roy said:
well, it seems that this is somehow linked to my default gmail account in chrome. I've cleared the cache and cookies but its still there. But, if i switch my gmail to another account, its back to normal. On a serious note now, shall i avoid or at least reduce web scraping for a few days or maybe like a week?
I may be overthinking this but the same email id is associated with all Google Platforms( Ads, Analytics & Search Console) for my website. Could this have an indirect negative impact on the associated properties? Because that's the last thing i'd wish for

Just curious, but why are you doing all of the scraping on the same machine you check your gmail? Are you at least using proxies?

Don't sh*t where you eat.

Aniket Roy · Jul 3, 2020

Trolling4Dollars said:
Just curious, but why are you doing all of the scraping on the same machine you check your gmail? Are you at least using proxies?

Don't sh*t where you eat.

actually i'm completely new to this whole automated scraping thing. i know nothing of the dos and don'ts. Can you please suggest what approach i should be taking?

Trolling4Dollars · Jul 3, 2020

Aniket Roy said:
actually i'm completely new to this whole automated scraping thing. i know nothing of the dos and don'ts. Can you please suggest what approach i should be taking?

Just do everything in your power to create a layer of isolation between yourself, personally, and your IM activities.

I'm fortunate that I'm able to have a few of my own machines physically located in different places. If not an option for you, get a virtual private server - a "VPS" - (some are even free). Do all of your work on one. Invest in proxies. The type (or more appropriate, the quality) you need will depend on your activities.

Google will always be smarter than you, smarter than me. Having said that, if I never comingle my personal & IM lives, they'll have a much harder time ever knowing who I am & what I'm up to.

HustleTong · Jul 3, 2020

Hi bot

Aniket Roy · Jul 3, 2020

Trolling4Dollars said:
Just do everything in your power to create a layer of isolation between yourself, personally, and your IM activities.

I'm fortunate that I'm able to have a few of my own machines physically located in different places. If not an option for you, get a virtual private server - a "VPS" - (some are even free). Do all of your work on one. Invest in proxies. The type (or more appropriate, the quality) you need will depend on your activities.

Had no idea that google keeps such intense track of my activities to the extent that I even be required to set up a VPS. thanks for the advice.

HustleTong said:
Hi bot

Has Google identified me as a bot? (This is strange)

Regular Member

Regular Member

Power Member

Regular Member

Power Member

Elite Member

Elite Member

Elite Member

Administrator

Banned - Shitlisted and did not do the right thing

Banned - Multiple Rules Violations

Regular Member

Regular Member

Regular Member

Newbie

Power Member

Regular Member

Power Member

Elite Member

Regular Member

Main Menu

Marketplace

Making Money

BlackHat World