majestic seo has found my PBN
- Thread starter nonai
- Start date
lucasbraydon
Supreme Member
- Nov 9, 2013
- 1,252
- 1,580
I don't know how good it is but have a look at this http://www.blackhatworld.com/blackh...de-your-private-blog-network-competitors.html
- Sep 22, 2013
- 1,209
- 1,670
There are so many versions of majestic bots crawling around and sucking behemoth amount of bandwidth so you may have entered just a single user agent and missed the others. Please post the user agent code that you have on your .htaccess to block the MJ12bot. Also, the easiest way to identify them is by checking out the raw hit logs/awstats on your cPanel for your PB.
I am not running wordpress so plugins wont work for me, I need to block them through htaccess.
out of all the things I am blocking, the only majestic seo is MJ12bot
I didn't know there are many bot names for majestic, I thought that's their only name.
I will try and see what i can do as far as logs go.
out of all the things I am blocking, the only majestic seo is MJ12bot
I didn't know there are many bot names for majestic, I thought that's their only name.
I will try and see what i can do as far as logs go.
- Jun 7, 2012
- 4,243
- 1,387
blocking majectic bit is next to impossible in my tests, they are very sneaky and have lot of variations from a range of IP's
- Sep 22, 2013
- 1,209
- 1,670
Yes it's virtually impossible to block them through IP's as their crawlers are crowdsourced and crawl webpages by the end users like you and me.
OP, put this in your robots.txt
User-agent: MJ12bot
Disallow: /
and shoot an email with the hit logs to [email protected] and request them to stop crawling your site.
twilightofidols
Power Member
- Nov 11, 2011
- 675
- 227
Majestic is a huge pain the ass. You could also disallow all bots except Google, Bing/Yahoo, Yandex and hope they follow it.
Majestic is a distributed bot run from all over the world. Look at majestic12.co.uk for more detail. Also, look in the Majestic FAQ:
How can I see more detailed information for my site?
By registering with us you can add your own websites to your profile to see detailed analysis of backlinks and anchor text. This information is prioritised to show the most important backlinks first, rather than showing a random sample (this helps gives prominence to the more important backlinks). The catch is that in exchange for free basic information about anchor text and backlinks for your site you will have to allow our bot (MJ12bot) to crawl your site for at least 12 months since your last usage of reports. In the vast majority of cases (95%+) you already do that, so in this case there is no catch really: only those who specifically disallowed our bot in their robots.txt or only allow a handful of other bots to crawl and disallow all the rest, will need to decide if they want to allow us crawl them in exchange for the free information that they can get. We hope your decision will be positive!
How can I see more detailed information for my site?
By registering with us you can add your own websites to your profile to see detailed analysis of backlinks and anchor text. This information is prioritised to show the most important backlinks first, rather than showing a random sample (this helps gives prominence to the more important backlinks). The catch is that in exchange for free basic information about anchor text and backlinks for your site you will have to allow our bot (MJ12bot) to crawl your site for at least 12 months since your last usage of reports. In the vast majority of cases (95%+) you already do that, so in this case there is no catch really: only those who specifically disallowed our bot in their robots.txt or only allow a handful of other bots to crawl and disallow all the rest, will need to decide if they want to allow us crawl them in exchange for the free information that they can get. We hope your decision will be positive!
spanishduez
Newbie
- Apr 1, 2014
- 21
- 1
Check your logs for the actual crawler from majestic so you could block it if you have not already done so. At the end of the day, it is their choice whether or not to crawl your sites.
ezines
Power Member
- Jan 3, 2011
- 723
- 223
True, they even published a blog post about it here;
Code:
http://blog.majesticseo.com/general/verifying-site-majesticseo-every-seo-audit/I guess blocking it at both .htaccess and robots.txt would do?
hello
maybe this help you add this rule in .htaccess
RewriteCond %{HTTP:User-Agent} (?:Owlinbo|BLEXBot|XoviBot|SEOkicks|meanpathbot|360Spider|SemrushBot|genieo|spbot|MJ12bot|AhrefsBot|SearchmetricsBot|Zeus|DotBot|Mail.RU_Bot|Ezooms|rogerbot|James) [NC]
RewriteRule .? - [F]
block majestic , all mozbot variations , ahref and others
best
maybe this help you add this rule in .htaccess
RewriteCond %{HTTP:User-Agent} (?:Owlinbo|BLEXBot|XoviBot|SEOkicks|meanpathbot|360Spider|SemrushBot|genieo|spbot|MJ12bot|AhrefsBot|SearchmetricsBot|Zeus|DotBot|Mail.RU_Bot|Ezooms|rogerbot|James) [NC]
RewriteRule .? - [F]
block majestic , all mozbot variations , ahref and others
best
Hi guys, I had the same issue this week, I blocked majestic bots on my .htaccess file but it got resetted for what ever reason and now my PBN site is showing as a reffering domains when I analyse my money site with Majestic.
Do you guys know if it's possible to delete it from their listing if so how ? Can we contact them to request it ?
I bought my PBN domain like 350$ so it's really pissing me of, because I dont want to delete it.
What do you guys think ?
Thanks
Do you guys know if it's possible to delete it from their listing if so how ? Can we contact them to request it ?
I bought my PBN domain like 350$ so it's really pissing me of, because I dont want to delete it.
What do you guys think ?
Thanks
SupremeBoner
Junior Member
- Jan 8, 2015
- 108
- 23
Stats of pbn? tbh i wanna know what a 350$ pbn looks like nowadays
You cant ask them to remove it from what i know
Better idea is to make the pbn real fancy so it fools any seos looking at it.
Thank for your reply
There is now way they can drop the domain from their database ? If when they crawl back my PBN and they get a 404 error or Server Drop Out Code ?
Since I reblocked the bots with a pluging instead of the htaccess, what will happen to the backlink if they are not able to crawl back my website ? the backlink will stay alive, will be marked as removed or they will remove it ? (The last option would be awesome)
What do you guys think ?
But once they crawled i think no use now and your old page will be in their server. Only thing you can do is to avoid any future content crawled by them. Are you sure they crawled after you added .htaccess condition?
Also check your .htaccess condition, in general it is case sensitive, to skip case you have to use [NC]. may be you can create own mjbot useragent like mjbot and try access your site and see .htaccess can able to correctly identify and block it. you can do this using "inspect element" in chrome or mozilla.
Also check your .htaccess condition, in general it is case sensitive, to skip case you have to use [NC]. may be you can create own mjbot useragent like mjbot and try access your site and see .htaccess can able to correctly identify and block it. you can do this using "inspect element" in chrome or mozilla.
mainceaft
Senior Member
- Apr 10, 2013
- 838
- 170
j majestic are screamers
I catch their bot uses Googlebot User Agent . even they are using proxies to hide there real IP's . I already reported on them to one of ISP in Europe after use their IP in sneaky way . Personally I hope someone nuke their entire network with some multi-gigabyte DDos Attack
I catch their bot uses Googlebot User Agent . even they are using proxies to hide there real IP's . I already reported on them to one of ISP in Europe after use their IP in sneaky way . Personally I hope someone nuke their entire network with some multi-gigabyte DDos Attack
