1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to avoid your website getting crawled by facebook?

Discussion in 'Black Hat SEO' started by ryanhackmachine, Jan 5, 2011.

  1. ryanhackmachine

    ryanhackmachine Regular Member

    Joined:
    May 8, 2010
    Messages:
    384
    Likes Received:
    223
    Occupation:
    Spend Money
    Location:
    In front of my desktop pc
    How to avoid your website getting crawled by facebook? Is This Possible?
     
  2. Debian

    Debian Jr. VIP Jr. VIP Premium Member

    Joined:
    Feb 17, 2009
    Messages:
    952
    Likes Received:
    335
    Occupation:
    Residential Remote Desktops
    Home Page:
    Use your .htaccess file and blacklist them.
     
    • Thanks Thanks x 1
  3. cyberzilla

    cyberzilla Elite Member Premium Member

    Joined:
    Nov 15, 2009
    Messages:
    2,205
    Likes Received:
    3,366
    Location:
    zeta reticuli
    The robots.txt file can be used to stop a search engine spider from crawling all or part of your site. Same applies to Facebook.
     
    • Thanks Thanks x 1