1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to avoid your website getting crawled by facebook?

Discussion in 'Black Hat SEO' started by ryanhackmachine, Jan 5, 2011.

  1. ryanhackmachine

    ryanhackmachine Regular Member

    Joined:
    May 8, 2010
    Messages:
    380
    Likes Received:
    223
    Occupation:
    Spend Money
    Location:
    In front of my desktop pc
    How to avoid your website getting crawled by facebook? Is This Possible?
     
  2. Debian

    Debian Jr. VIP Jr. VIP Premium Member

    Joined:
    Feb 17, 2009
    Messages:
    714
    Likes Received:
    282
    Occupation:
    Residential Proxies & VPN's
    Home Page:
    Use your .htaccess file and blacklist them.
     
    • Thanks Thanks x 1
  3. cyberzilla

    cyberzilla Elite Member Premium Member

    Joined:
    Nov 15, 2009
    Messages:
    2,204
    Likes Received:
    3,364
    Location:
    zeta reticuli
    The robots.txt file can be used to stop a search engine spider from crawling all or part of your site. Same applies to Facebook.
     
    • Thanks Thanks x 1