Do you block DataForSEO's crawler on your PBN sites?

Kanye West

Junior Member

Aug 15, 2014

147

39

• Nov 28, 2023

• #1

As more and more SEO tools are buying backlink data from DataForSEO (B2B SEO data seller), their crawler has become more significant.

To all of you hiding your PBNs from SEO tools: Is DataForSEO's crawler in your .htaccess block list on your PBN sites?

 

BlackShield

Elite Member

Jr. VIP

Jun 25, 2015

4,024

869

• Nov 28, 2023

• #2

Prevent DataForSEO's crawler from accessing your PBN sites by adding it to the block list in your .htaccess file for increased privacy from SEO tools.

 

Steptoe

Elite Member

Jr. Executive VIP

Jr. VIP

Aug 9, 2017

5,587

6,871

• Nov 28, 2023

• #3

There comes to a point where you might as well block everything except Google ASN (minus inspect tools) from your own PBNs.

 

alexsimkovitz

BANNED

Dec 10, 2023

80

17

• Dec 18, 2023

• #4

No, we do not block DataForSEO's crawler on our PBN sites.

 

Stifmeister

Supreme Member

Jr. VIP

Sep 29, 2011

1,214

524

• Dec 18, 2023

• #5

Wouldn't blocking seo tools be a footprint/dead giveaway that it's a pbn?

Why would a blog about cats block such things?

 

hideath

Elite Member

Jun 16, 2019

6,620

7,350

• Dec 18, 2023

• #6

Steptoe said:

There comes to a point where you might as well block everything except Google ASN (minus inspect tools) from your own PBNs.

Click to expand...

& Bing, some websites, especially the new & small ones get a handful of traffic in there,

OP, rather than blocking a set of bots,
accept only Google & other search engines bots and block everything else, that will be much easier,
using htaccess will be a safer/wiser option,
and even creating a cloacking script to hide the links for all users & bots except the metioned above would be better