Tool to search competitor's data?

Discussion in 'Black Hat SEO' started by christianbed, Feb 13, 2012.

  1. christianbed

    christianbed Jr. VIP Jr. VIP

    Joined:
    Aug 17, 2011
    Messages:
    1,419
    Likes Received:
    928
    Location:
    alert("Make Money")
    Home Page:
    Wondering if there is a tool that will allow me to search competitor's sites for stuff they've left on a public folder, pdf's , doc's, ppt's, xls, etc? Could be useful.
     
  2. G-S-T

    G-S-T Executive VIP Jr. VIP

    Joined:
    Jan 20, 2011
    Messages:
    1,929
    Likes Received:
    8,939
    Occupation:
    Full time IM
    Location:
    Heavy in the game
    Try looking at the robots.txt file and see if they have blocked spiders from accessing any section of their site. Also check their sitemap.

    Finally try *.pdf site:facebook.com
     
    • Thanks Thanks x 1