Looking for duplicate removal tool

Discussion in 'Black Hat SEO Tools' started by cyrsss, Jan 3, 2011.

  1. cyrsss

    cyrsss Regular Member

    Joined:
    Jul 10, 2010
    Messages:
    398
    Likes Received:
    64
    Occupation:
    SEO Analyst
    Location:
    SKY
    As I don't find Specific tool or website yet.

    Let suppose you have list of 1000 URLs

    But some URL repeat itself like

    Code:
    http://www.insidethebook.com/ee/index.php/P4560/
    http://www.insidethebook.com/ee/index.php/site/article/do_low_talent_teams_overspend_on_free_agents/
    http://www.insidethebook.com/ee/index.php/P4560/
    Is there any free tool or website which specifically eliminate such url and results are just profile link instead of three ??

    Like

    Not all three. I know scrap box do it but i don't have right now :eek: So asking for free

    Thanks in advance