1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

how do you block..

Discussion in 'Black Hat SEO' started by Checkmate, Aug 16, 2010.

  1. Checkmate

    Checkmate Elite Member

    Joined:
    Aug 9, 2010
    Messages:
    1,536
    Likes Received:
    639
    How do you block or filter out bots hitting your site?

    My hits been extremely high the past 2 days I'm guessing due to bots (bots from twitter, if you use twitter you know what I mean) hitting it.
    Posted via Mobile Device
     
  2. likeskoolaid

    likeskoolaid Regular Member

    Joined:
    Dec 27, 2009
    Messages:
    352
    Likes Received:
    104
    Occupation:
    \˚ㄥ˚\
    Location:
    \ᇂ_ᇂ\
    you can't, bots use regular people's IP's. usually they are normal people's infected computer's.. there's no way you can restrict these IP's but still allow real people to access, there's no way to tell the difference. '' ' ' ' '
     
  3. deathclick

    deathclick Junior Member

    Joined:
    Aug 9, 2010
    Messages:
    131
    Likes Received:
    55
    Location:
    San Jose, California
    Your question is a little vague, but if you mean excluding robots from your html website, then exclude them in the robots.txt file. You need to know the user-agent and put it in the file with the directory subtree you want the robot to ignore. This can be / for everything. Malicious bots ignore the robots.txt, and sometimes the only way to stop them is to block their IP address or something like that. The proxied ones can be extremely hard to stop without some custom code.
     
  4. bzy39

    bzy39 Regular Member

    Joined:
    Jan 15, 2009
    Messages:
    434
    Likes Received:
    239
    if you know the bot name, you can filter it, if you use wordpress try using Chennai Central to save bandwidth and add the bot name you want to filter.