Blocking robots on money site?

[codeman1234]

Hello guys,

I got a question, does anyone blocks robots on money site? In case you want to hide some backlinks you don't control from competitors? Or what is the best way to do this? Since it feels odd to block robots on money site? What you guys think?

Thanks

 

[codeman1234]

This is what the disavow tools for you can disalow the actual links no need to block crawlers.

Hello Xdurance,

Thanks for the reply but, you misunderstood me or I did not explain correctly, what I mean is that there some links on the backlinks profile of one money site I want to hide from competitors to avoid them to copy my way of getting this links, what is my only option to block robots? is this right to do on money site?

Thanks!

 

[qrazy]

Most of these SEO related bots will just ignore the robots.txt, so you might need to block them by useragent/IP in htaccess file.

 

[codeman1234]

Most of these SEO related bots will just ignore the robots.txt, so you might need to block them by useragent/IP in htaccess file.

Hey Grazy,

Thanks for the reply! Yes, I know how to block them on htaccess that is not the issue my question is basically if is recommended to block bots on money sites? and if there is other more recommended way to do this so it does not looks odd to Google?

Thanks!

 

[qrazy]

Hey Grazy,

Thanks for the reply! Yes, I know how to block them on htaccess that is not the issue my question is basically if is recommended to block bots on money sites? and if there is other more recommended way to do this so it does not looks odd to Google?

Thanks!

I don't know of any other methods to block these bots than htaccess/robot. And if you do it via htaccess, only your server would know about the rule/condition, not google or anyone else.

 

[codeman1234]

Most of these SEO related bots will just ignore the robots.txt, so you might need to block them by useragent/IP in htaccess file.

Question still remains, what I mean is does it look unnatural for Google for a site to block bots?


Thanks!

 

[qrazy]

Question still remains, what I mean is does it look unnatural for Google for a site to block bots?


Thanks!

As I mentioned, If you do it via htaccess, google will have no idea whether you blocked any of the other bots or not, So logically it shouldn't have any (+ve or -ve) impact at all.

 

[blogtaufiq]

you can try https://wordpress.org/plugins/spiderblocker/

 

[Nicheblogger]

Blocking crawlers on your money site is pointless. You would need to block crawling on the site that links to your money site to get the effect you seem to be looking for.

 

[Furious Man]

spiderblocker ill help you u can try that one