1. This website uses cookies to improve service and provide a tailored user experience. By using this site, you agree to this use. See our Cookie Policy.
    Dismiss Notice

[Get] Duplicate deletion utility

Discussion in 'Black Hat SEO Tools' started by JustUs, Jul 22, 2015.

  1. JustUs

    JustUs Power Member

    May 6, 2012
    Likes Received:
    In one of the projects that I am working on I needed a utility that would delete links from one file that were in another file. So, I quickly wrote one. Then I realized that the same utility would be useful for IP addresses and comments in addition to URL's. So I rewrote the Utility to handle those as well.

    The code is nothing fancy and is not multi threaded; the code is just down and dirty 'make it work' kludged code. No real attempt at optimization was made, and there was no real attempt at code reuse. In the 64 bit compilation I tested a 1.3 million link file against another 1.3 million link file in which there were only two shared urls. I also repeated this same test with IP's. With that many url's or IP's, the program took a couple of hours to complete. When tested against more realistic files of 100,000 plus url's or IP's, the program would complete in a few seconds to a few minutes dependent on the particulars of the files.

    Here are images:
    url/link deletion

    IP deletion

    Comment deletion

    Because I occasionally see people asking about this type of utility, I decided to make the source code and the executable available. The executables are in the Link_delete.rar\link_delete\link_delete\bin\x64\Release and the Link_delete.rar\link_delete\link_delete\bin\x32\Release and are named link_delete.exe. The "No separator" check box is specific to the project this was written for.

    This utility is written for dot net 4.5 and was written with Visual Studio 2013.

    The virus totals are:
    64 bit executable: (0/54)

    32bit executable: (0/55)

    If you are interested, you may download the source and executables from:

    Have phun.
    • Thanks Thanks x 2
    Last edited: Jul 22, 2015
  2. liona1982

    liona1982 Newbie

    Feb 11, 2017
    Likes Received:
    Well, according to me in my opinion Duplicate Files Deleter is the best because I am still using it now for more than 3 years & will continue to do so as it is so user friendly, simple to use & you can do anything with it & I would definitely recommend it to everyone out there who wants to sort/manage/delete any of their duplicate files & you can choose to delete any files you don't want across all platforms just like myself who have been using this amazing software without any problems. Also it supports all file extensions out there. But please backup important files first. Please use it to believe me & I am being serious here.