1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

List of Instagram Crawlers

Discussion in 'Cloaking and Content Generators' started by rpkrocks, Feb 15, 2017.

  1. rpkrocks

    rpkrocks Jr. VIP Jr. VIP

    Joined:
    Feb 4, 2010
    Messages:
    986
    Likes Received:
    933
    Gender:
    Male
    Location:
    Bḥārata
    Home Page:
    Hello, Does anyone has a list of IG crawlers/bots to block them via robots.txt/.htaccess?
     
  2. mnunes532

    mnunes532 Supreme Member

    Joined:
    Jan 21, 2014
    Messages:
    1,350
    Likes Received:
    415
    Gender:
    Male
    Location:
    Portugal
  3. rpkrocks

    rpkrocks Jr. VIP Jr. VIP

    Joined:
    Feb 4, 2010
    Messages:
    986
    Likes Received:
    933
    Gender:
    Male
    Location:
    Bḥārata
    Home Page:
  4. mnunes532

    mnunes532 Supreme Member

    Joined:
    Jan 21, 2014
    Messages:
    1,350
    Likes Received:
    415
    Gender:
    Male
    Location:
    Portugal
    Yes, its the same company after all.
     
    • Thanks Thanks x 1
  5. erf499

    erf499 Newbie

    Joined:
    Nov 6, 2016
    Messages:
    27
    Likes Received:
    3
    Gender:
    Male
    I dont think its gonna be that simple