GregFromMoonsy
Power Member
- Aug 12, 2018
- 598
- 261
After reading this article https://moz.com/blog/blindspots-in-the-link-graph
Shared by @theRevolt
I am indignant as Moz makes water from the brain of people.
Moz trying to hide the fact, that their crawlers are blocked by simple block whole IP ranges of Amazon AWS, which they using for crawling web.
At the end, Cyrus as master Moz propaganda specialist wrote: Cost of success ( oh yeah... )
Where the success real mean: that webmasters can block all MOZ (and Ahrefs) crawlers within 10 seconds, even without touch robots.txt
And thereafter, they can't crawling site at all (including robots.txt)
Because Majestic scale their crawlers horizontally with clustering, they're very hard to block by mentioned way.
For this reason Majestic is most often seen in robots.txt
What is pretty visible on last image in mentioned article.
Of course also no single word about this fact in Moz blah blah article.
When somebody blocking MOZ in just 10 seconds, Cyrus from MOZ called it "success"
In comments, you can meet also Tim Soulo from Ahrefs
Greg.
Shared by @theRevolt
I am indignant as Moz makes water from the brain of people.
Moz trying to hide the fact, that their crawlers are blocked by simple block whole IP ranges of Amazon AWS, which they using for crawling web.
At the end, Cyrus as master Moz propaganda specialist wrote: Cost of success ( oh yeah... )
Where the success real mean: that webmasters can block all MOZ (and Ahrefs) crawlers within 10 seconds, even without touch robots.txt
And thereafter, they can't crawling site at all (including robots.txt)
Because Majestic scale their crawlers horizontally with clustering, they're very hard to block by mentioned way.
For this reason Majestic is most often seen in robots.txt
What is pretty visible on last image in mentioned article.
Of course also no single word about this fact in Moz blah blah article.
When somebody blocking MOZ in just 10 seconds, Cyrus from MOZ called it "success"
In comments, you can meet also Tim Soulo from Ahrefs
Greg.
Last edited:
