1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

blocking bots?

Discussion in 'Black Hat SEO' started by schleprock, Dec 11, 2016.

  1. schleprock

    schleprock Regular Member

    Joined:
    Apr 10, 2014
    Messages:
    438
    Likes Received:
    26
    I know that some people use htaccess to stop some bots from crawling their site. Can I use it to stop bots from crawling on my site. Will it work in the situation below?


    I use ClickMagic to track what is happening on my articles that have affiliate offers on them. Today I received more fake clicks than real clicks. Of course, Native Ads is charging me for all of the clicks whether they are real or not.


    Why would Amazon crawl my site, I don't have any Amazon offers on my site, but I still have to pay NativeAds when they crawl on it.

    I also have "servers" crawling my site. Why would they be crawling my site. Who are these people:
    ColoCrossing
    Turnkey Internet
    Contina

    There were more "servers" that is just an example of automation tools who don't seem to have any reason to be there.

    They are all visiting and costing me money. Are they using server resources when they visit too.

    • Is there a way for me to stop some of this stuff.
    • Why would any of them bother to visit, there is nothing for them on that page
    Thanks for considering this question
     
  2. GWalkaa

    GWalkaa Registered Member

    Joined:
    Aug 17, 2014
    Messages:
    55
    Likes Received:
    2
    I dont know the answer but im in a very similar situation.