[Guide] Find your competitors hidden PBN/ backlinks of any website for free.

MJ

Jr. VIP
Jr. VIP
Joined
Jan 6, 2015
Messages
1,017
Reaction score
543
Website
glovoice.com
Hello BHW!

I was playing around with Bing WMT and found something interesting. You can find all backlinks of any domain using the Bing Webmaster tools! Isn't it amazing :D ? Keep reading to know more.
First, you need to add your site to Bing webmaster tools. Once you do that, head over to the backlinks tab from the sidebar.

1. Backlinks tab.jpg
Over here, select the "Similar Sites" from the top tab on the backlinks page.
2. Add site.jpg

Now, Bing allows you to add up to 3 sites to compare your own site with. On this window, your site will be selected by default. Next to it, add your competitor's website and uncheck the slider for your site. Once you do that, it will display all the Referring domains pointing towards your competitor's domain. Just scroll down and click on "Detailed Report." At this point, you can even go ahead and download all the links. But the downloaded file will include only the root linking domains, not the exact page referring to your competitor.

3. Detailed report.jpg


4. All RD.jpg

Further, from this list, just click on any domain, and it will show you the exact page that is referring to your competitor's URL. Checkout the sample below for BHW.

The gold.jpg

You will be able to see *most* of your competitors' referring domains since most PBNs do not block BingBot. Bing is comparatively slower in crawling, so it might take some time for new backlinks to show up.

You can also use it to find all the backlinks of any website if you do not want to spend money on premium tools like Ahrefs or Semrush.

How to identify if particular site is PBN?
Simple, just check out the robots.txt file. So, if your domain is example .com, then you can see the robots file at - example.com/robots.txt
If you find that significant crawlers are blocked, then it is definitely a PBN.
Example code:

Code:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
User-agent: AhrefsBot
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: SemrushBot
Disallow: /


Note: If this post helped you, do not hesitate to hit the "Like" button.
Another Note: English is not my first language so please bear. :D
 

Halch

Junior Member
Joined
Feb 14, 2016
Messages
177
Reaction score
356
You got me to submit to BSC. I've been putting it aside, but this seems like something fun to test. Now just have to wait for 2 days.
 
  • Like
Reactions: MJ

Panther28

Jr. Executive VIP
Jr. VIP
Joined
May 2, 2010
Messages
6,038
Reaction score
9,009
Cool, a handy way to find backlinks of your competition. How did you come across this? By accident? Well done. Cheers.
 

SirLouen

Jr. Executive VIP
Jr. VIP
Joined
Jan 17, 2015
Messages
3,815
Reaction score
2,863
Website
linktr.ee
Note: If this post helped you, do not hesitate to hit the "Like" button.

Nice one :) Hit the like button, subscribed and retweeted :p
But tested with one of my sites, and I cannot even see the Wikipedia link to a super-important page it has! This bing crawler...
 

MJ

Jr. VIP
Jr. VIP
Joined
Jan 6, 2015
Messages
1,017
Reaction score
543
Website
glovoice.com
Nice one :) Hit the like button, subscribed and retweeted :p
But tested with one of my sites, and I cannot even see the Wikipedia link to a super-important page it has! This bing crawler...
Yeah Bing is unpredictable. It had crawled many pages with spun content and indexed those links but it is still not able to find the Wiki link that I had created. :D
 

HenryObi

Jr. VIP
Jr. VIP
Joined
Sep 7, 2017
Messages
3,426
Reaction score
2,582
Website
8x-Your-Traffic-Like-Me-With-This-Ebook.online
Hello BHW!

I was playing around with Bing WMT and found something interesting. You can find all backlinks of any domain using the Bing Webmaster tools! Isn't it amazing :D ? Keep reading to know more.
First, you need to add your site to Bing webmaster tools. Once you do that, head over to the backlinks tab from the sidebar.

View attachment 166080
Over here, select the "Similar Sites" from the top tab on the backlinks page.
View attachment 166081

Now, Bing allows you to add up to 3 sites to compare your own site with. On this window, your site will be selected by default. Next to it, add your competitor's website and uncheck the slider for your site. Once you do that, it will display all the Referring domains pointing towards your competitor's domain. Just scroll down and click on "Detailed Report." At this point, you can even go ahead and download all the links. But the downloaded file will include only the root linking domains, not the exact page referring to your competitor.

View attachment 166082


View attachment 166083

Further, from this list, just click on any domain, and it will show you the exact page that is referring to your competitor's URL. Checkout the sample below for BHW.

View attachment 166084

You will be able to see *most* of your competitors' referring domains since most PBNs do not block BingBot. Bing is comparatively slower in crawling, so it might take some time for new backlinks to show up.

You can also use it to find all the backlinks of any website if you do not want to spend money on premium tools like Ahrefs or Semrush.

How to identify if particular site is PBN?
Simple, just check out the robots.txt file. So, if your domain is example .com, then you can see the robots file at - example.com/robots.txt
If you find that significant crawlers are blocked, then it is definitely a PBN.
Example code:

Code:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
User-agent: AhrefsBot
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: SemrushBot
Disallow: /


Note: If this post helped you, do not hesitate to hit the "Like" button.
Another Note: English is not my first language so please bear. :D
A really nice trick, but I don't know what I would need my competitors' PBNs for. Unless I want the same provider to sell their service to me.
 

INCC

Jr Vip
Jr. VIP
Joined
Feb 12, 2018
Messages
3,084
Reaction score
2,213
I just tried to check my competitors.

1. Bing didn't manage to get any data for site 1 (it's on first page in G so it's odd)

2. For the second site Bing found only 88 referring domains - Ahrefs has found 480

I don't think it's a very good way to get the data because for whatever reason most links are not shown in the first place (or like you said, Bing is slower at crawling)
 
Last edited:

MJ

Jr. VIP
Jr. VIP
Joined
Jan 6, 2015
Messages
1,017
Reaction score
543
Website
glovoice.com
A really nice trick, but I don't know what I would need my competitors' PBNs for. Unless I want the same provider to sell their service to me.
I just use it to gauge the amount of links I would need to outrank the competitor.

I just tried to check my competitors.

1. Bing didn't manage to get any data for site 1 (it's on first page in G so it's odd)

2. For the second site Bing found only 88 referring domains - Ahrefs has found 480

I don't think it's a very good way to get the data because for whatever reason most links are not shown in the first place (or like you said, Bing is slower at crawling)
Yeah I think Bing is kind of slow/ unpredictable. I have added my new blog, which is ~8 months old and Bing has already discovered more than 80% of RDs.
 

nolimits111

Newbie
Joined
Apr 12, 2011
Messages
6
Reaction score
6
Interesting, and useful information. Bing is kinda mysterious and as others have found, slower to the draw.
Thank you!
 
  • Like
Reactions: MJ

sev1024

Junior Member
Joined
Apr 10, 2020
Messages
119
Reaction score
62
Hello BHW!

I was playing around with Bing WMT and found something interesting. You can find all backlinks of any domain using the Bing Webmaster tools! Isn't it amazing :D ? Keep reading to know more.
First, you need to add your site to Bing webmaster tools. Once you do that, head over to the backlinks tab from the sidebar.

View attachment 166080
Over here, select the "Similar Sites" from the top tab on the backlinks page.
View attachment 166081

Now, Bing allows you to add up to 3 sites to compare your own site with. On this window, your site will be selected by default. Next to it, add your competitor's website and uncheck the slider for your site. Once you do that, it will display all the Referring domains pointing towards your competitor's domain. Just scroll down and click on "Detailed Report." At this point, you can even go ahead and download all the links. But the downloaded file will include only the root linking domains, not the exact page referring to your competitor.

View attachment 166082


View attachment 166083

Further, from this list, just click on any domain, and it will show you the exact page that is referring to your competitor's URL. Checkout the sample below for BHW.

View attachment 166084

You will be able to see *most* of your competitors' referring domains since most PBNs do not block BingBot. Bing is comparatively slower in crawling, so it might take some time for new backlinks to show up.

You can also use it to find all the backlinks of any website if you do not want to spend money on premium tools like Ahrefs or Semrush.

How to identify if particular site is PBN?
Simple, just check out the robots.txt file. So, if your domain is example .com, then you can see the robots file at - example.com/robots.txt
If you find that significant crawlers are blocked, then it is definitely a PBN.
Example code:

Code:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
User-agent: AhrefsBot
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: SemrushBot
Disallow: /


Note: If this post helped you, do not hesitate to hit the "Like" button.
Another Note: English is not my first language so please bear. :D


This is fricken great man. Should definitely help in the strategy build out for new launches!
 
  • Like
Reactions: MJ

sazerac

Junior Member
Premium Member
Joined
Jul 29, 2018
Messages
101
Reaction score
90
Excellent guide. Clever, succinct, and useful. Thank you.
 
  • Like
Reactions: MJ
Top