1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

EPIC robots.txt file!

Discussion in 'BlackHat Lounge' started by M4XW3LL, Aug 8, 2014.

  1. M4XW3LL

    M4XW3LL Senior Member

    Joined:
    Feb 5, 2013
    Messages:
    1,052
    Likes Received:
    1,247
    • Thanks Thanks x 7
  2. YouTubez

    YouTubez Regular Member

    Joined:
    Feb 3, 2013
    Messages:
    327
    Likes Received:
    140
    Occupation:
    YouTube Marketing
    Such a sad tale of woe....
     
  3. keyboard

    keyboard BANNED BANNED

    Joined:
    May 26, 2010
    Messages:
    234
    Likes Received:
    55
    haha someone has 2 much time.
     
  4. IceHD

    IceHD Jr. VIP Jr. VIP Premium Member

    Joined:
    May 8, 2013
    Messages:
    485
    Likes Received:
    198
    Occupation:
    SEO, SEM, HTML5&CSS3 Coder
    Location:
    Not Romania
    Ha ha ha, great find dude
     
  5. LostConnection

    LostConnection Senior Member

    Joined:
    Jul 20, 2014
    Messages:
    1,172
    Likes Received:
    1,350
    Location:
    Grinding away in the night
    When does he/she make the money if they spend most of their time writing robots.txt? :D
     
  6. ephman

    ephman Junior Member

    Joined:
    Jun 12, 2014
    Messages:
    170
    Likes Received:
    50
    "i mean wtf is up with all those changes?. now it feels like seo is like russian roulette" :d


    .-.
    # __ _| '-----------._____________.-'\
    # `-.`\,' .======. \ ===== ======= \==.
    # __.' || (___|- = = |----------------| |
    # / ,_ || ___| - - -|________________/ |
    # / / / || (___| = = =|________________)=='
    # | (_/ '======'_-- -/
    # / (_ii== /
    # | .---. ___/
    # / ::. .--. /\ / |(
    # | .::::. / \\ \( //
    # / .:::::: | '-----'
    # ; :::::::: |
    # | :::::::: |
    # |::::::::: |
    # /::::::::: |
    # '-----------'
     
  7. M4XW3LL

    M4XW3LL Senior Member

    Joined:
    Feb 5, 2013
    Messages:
    1,052
    Likes Received:
    1,247
    How do you come to the conclusion that he/she writes robots.txt files all the time? It's not like you're seeing 100 of those files, it's just one.
     
  8. ID Internet Marketer

    ID Internet Marketer Senior Member

    Joined:
    Jan 22, 2013
    Messages:
    938
    Likes Received:
    1,442
    Occupation:
    Blackhatworld Member
    Location:
    My Private ***
    it revealed how to write robots.txt properly :p
     
  9. gullsinn

    gullsinn Jr. VIP Jr. VIP Premium Member

    Joined:
    Dec 24, 2009
    Messages:
    2,429
    Likes Received:
    2,210
    Gender:
    Male
    Occupation:
    Jobless :D
    Location:
    Graveyard
    Home Page:
    #ALL THE ascii WORK HERE IS ATTRIBUTED TO Joan G. Stark, also known by jgs, (SHE was a prolific ASCII artist in the late 90s)

    He just added some text otherwise the credit goes to this lady.
     
  10. M4XW3LL

    M4XW3LL Senior Member

    Joined:
    Feb 5, 2013
    Messages:
    1,052
    Likes Received:
    1,247
    I think he should also get credits for the story.