1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

tool to compare 50 txt files for dup content?

Discussion in 'Black Hat SEO Tools' started by cdc515, May 22, 2010.

  1. cdc515

    cdc515 Power Member

    Joined:
    Nov 23, 2009
    Messages:
    602
    Likes Received:
    92
    is there a tool out there that will compare 50 txt files for duplicate content?
     
  2. bugaga

    bugaga Junior Member

    Joined:
    Jun 11, 2009
    Messages:
    108
    Likes Received:
    29
    looking for the same software
     
  3. electryk

    electryk Newbie

    Joined:
    May 16, 2010
    Messages:
    25
    Likes Received:
    2
    looking for the same stuff
     
  4. bbrez1

    bbrez1 Power Member

    Joined:
    Feb 21, 2009
    Messages:
    675
    Likes Received:
    2,360
    Am going to make one when I have some spare time if more people need it
     
  5. gonzalomagno

    gonzalomagno Newbie

    Joined:
    Jan 12, 2010
    Messages:
    1
    Likes Received:
    0
    Hi there!

    What you're looking for is this: http://www.digitalvolcano.co.uk/download/dc_down.html (Download)

    Specifications:

    Duplicate Cleaner - Find Duplicate Files

    http://www.digitalvolcano.co.uk/content/duplicate-cleaner

    "Find and delete duplicate files, mp3s, photos, old documents and much more. This fully featured, program will work at home or in a networked environment. Best of all Duplicate Cleaner is freeware, meaning you get the full program and it doesn't cost a thing!"



    • The fastest way to find duplicate files
    • Award Winning
    • Deep scan music formats - MP3, M4A, M4P, WMA, FLAC, OGG, APE, etc
    • Delete, move or hard link duplicate files. Save disc space!
    • Multiple language support.
    • For Microsoft Windows 2000, XP, Vista, Win 7.
    • This Duplicate File Cleaner is Freeware!


    • Find Duplicate Files by content, fast!
    • Cleaner hard drives means faster performance
    • Fast Scanning and accurate duplicate comparison (Uses the MD5 Hash algorithm)
    • Deep scans music - locate duplicate music formats (MP3, iTunes, etc)
    • Flexible search parameters
    • Intelligent Selection Assistant
    • Search home or networked drives
    • Search multiple locations
    • Export / Import results in CSV format
    • View Path,Size and Date of files
    • Large, resizable list window
    • Image preview window
    • Delete duplicate files to the Recycle bin
    • Move duplicate files to a new location
    • Turn duplicate file into hard links (NTFS file systems only)
    • Protection for Windows and system files
    • Supports multiple languages
    • No Spyware, Adware or any other rubbish
    • Free!
    I use it & let me say that's fantastic (you must scan for 'Same Content SCS', first checkbox at right side)

    Good Luck, Buddies!
     
  6. streetjammer

    streetjammer BANNED BANNED

    Joined:
    Sep 25, 2008
    Messages:
    115
    Likes Received:
    5
    @cdc515

    well if you gonna do it for zlinkslist first convert it to linkslist and then check it with the above software , actually you can do the duplicate filter with xrumer
     
  7. cdc515

    cdc515 Power Member

    Joined:
    Nov 23, 2009
    Messages:
    602
    Likes Received:
    92
    no its actually for a different project to compare different articles i have had written for me to tell how unique they are.