bleukh
Newbie
- Aug 14, 2023
- 18
- 8
Hey, i am looking for a way to avoid being banned in certain countries for my website. i heard that there is a way to add text to robots.txt to stepover spiders and crawlers that search for certain keywords to block websites.
If this is a way, can you please help me to do it? or if you have any other way of doing so - I am open to suggestions
Thanks a lot
If this is a way, can you please help me to do it? or if you have any other way of doing so - I am open to suggestions
Thanks a lot