List of Instagram Crawlers

Discussion in 'Cloaking and Content Generators' started by rpkrocks, Feb 15, 2017.

Thread Status:
Not open for further replies.
  1. rpkrocks

    rpkrocks BANNED BANNED

    Joined:
    Feb 4, 2010
    Messages:
    1,041
    Likes Received:
    971
    Gender:
    Male
    Hello, Does anyone has a list of IG crawlers/bots to block them via robots.txt/.htaccess?
     
  2. mnunes532

    mnunes532 Elite Member

    Joined:
    Jan 21, 2014
    Messages:
    1,687
    Likes Received:
    553
    Gender:
    Male
    Location:
    Portugal
  3. rpkrocks

    rpkrocks BANNED BANNED

    Joined:
    Feb 4, 2010
    Messages:
    1,041
    Likes Received:
    971
    Gender:
    Male
    Do they use the same crawlers for IG too?
     
  4. mnunes532

    mnunes532 Elite Member

    Joined:
    Jan 21, 2014
    Messages:
    1,687
    Likes Received:
    553
    Gender:
    Male
    Location:
    Portugal
    Yes, its the same company after all.
     
    • Thanks Thanks x 1
  5. erf499

    erf499 Newbie

    Joined:
    Nov 6, 2016
    Messages:
    28
    Likes Received:
    3
    Gender:
    Male
    I dont think its gonna be that simple
     
Thread Status:
Not open for further replies.