tool to compare 50 txt files for dup content?

Discussion in 'Black Hat SEO Tools' started by cdc515, May 22, 2010.

  1. cdc515

    cdc515 Power Member

    Joined:
    Nov 23, 2009
    Messages:
    602
    Likes Received:
    93
    is there a tool out there that will compare 50 txt files for duplicate content?
     
  2. bugaga

    bugaga Junior Member

    Joined:
    Jun 11, 2009
    Messages:
    108
    Likes Received:
    29
    looking for the same software
     
  3. electryk

    electryk Newbie

    Joined:
    May 16, 2010
    Messages:
    25
    Likes Received:
    2
    looking for the same stuff
     
  4. bbrez1

    bbrez1 Power Member

    Joined:
    Feb 21, 2009
    Messages:
    675
    Likes Received:
    2,362
    Am going to make one when I have some spare time if more people need it
     
  5. gonzalomagno

    gonzalomagno Newbie

    Joined:
    Jan 12, 2010
    Messages:
    1
    Likes Received:
    0
    Hi there!

    What you're looking for is this: http://www.digitalvolcano.co.uk/download/dc_down.html (Download)

    Specifications:

    Duplicate Cleaner - Find Duplicate Files

    http://www.digitalvolcano.co.uk/content/duplicate-cleaner

    "Find and delete duplicate files, mp3s, photos, old documents and much more. This fully featured, program will work at home or in a networked environment. Best of all Duplicate Cleaner is freeware, meaning you get the full program and it doesn't cost a thing!"



    • The fastest way to find duplicate files
    • Award Winning
    • Deep scan music formats - MP3, M4A, M4P, WMA, FLAC, OGG, APE, etc
    • Delete, move or hard link duplicate files. Save disc space!
    • Multiple language support.
    • For Microsoft Windows 2000, XP, Vista, Win 7.
    • This Duplicate File Cleaner is Freeware!


    • Find Duplicate Files by content, fast!
    • Cleaner hard drives means faster performance
    • Fast Scanning and accurate duplicate comparison (Uses the MD5 Hash algorithm)
    • Deep scans music - locate duplicate music formats (MP3, iTunes, etc)
    • Flexible search parameters
    • Intelligent Selection Assistant
    • Search home or networked drives
    • Search multiple locations
    • Export / Import results in CSV format
    • View Path,Size and Date of files
    • Large, resizable list window
    • Image preview window
    • Delete duplicate files to the Recycle bin
    • Move duplicate files to a new location
    • Turn duplicate file into hard links (NTFS file systems only)
    • Protection for Windows and system files
    • Supports multiple languages
    • No Spyware, Adware or any other rubbish
    • Free!
    I use it & let me say that's fantastic (you must scan for 'Same Content SCS', first checkbox at right side)

    Good Luck, Buddies!
     
  6. streetjammer

    streetjammer BANNED BANNED

    Joined:
    Sep 25, 2008
    Messages:
    115
    Likes Received:
    5
    @cdc515

    well if you gonna do it for zlinkslist first convert it to linkslist and then check it with the above software , actually you can do the duplicate filter with xrumer
     
  7. cdc515

    cdc515 Power Member

    Joined:
    Nov 23, 2009
    Messages:
    602
    Likes Received:
    93
    no its actually for a different project to compare different articles i have had written for me to tell how unique they are.