[help] duplicate domains remover

[banel]

Can anyone suggest me a good software that can remove duplicate domains from a list of urls ?

 

[tempnews]

If u are with linux type in the shell "sort filename.txt | uniq > newfilename.txt" ..

 

[dunhill]

just go to fiverr .. ask them to code for you..

 

[Tighearna]

Notepad++ can also do it.... but my money is with scrapebox

 

[banel]

I don't have unix neither scrapebox.
How can I use notepad to remove duplicate domains? I can't find nothing in the menu.

 

[extremephp]

This Would Help

http://office.microsoft.com/en-us/excel-help/delete-duplicate-rows-from-a-list-in-excel-HA001034626.aspx

~ExP~

 

[banel]

I need to delete the duplicate domains, not the duplicate urls. Like this:
www.site1.net/porsche
www.site2.net/windows
www.site1.net/bmw

==>> www.site1.net/porsche
www.site2.net/windows

 

[galus]

Try urlwasher, simple software.

 

[banel]

Hi, Galus, i have urlwasher. It's not good, it can only wash by full domain. The option with "by url" it's not good, i tested with a smaller list.

 

[tipstricks]

Can anyone suggest me a good software that can remove duplicate domains from a list of urls ?

Remove Duplicate URL ? Free Software
tipstrickstutorials.com/remove-duplicate-url-free-software/

 

[thomansfel]

paste your list here: textmechanic.com/Remove-Duplicate-Lines.html and you are done

 

[en.smartis]

pm me a txt and i can remove dups with scrapebox

 

[banel]

paste your list here: textmechanic.com/Remove-Duplicate-Lines.html and you are done

Thanks, but as I said in the first post I want to remove the duplicate domains, not duplicate lines.

Remove Duplicate URL ? Free Software
tipstrickstutorials.com/remove-duplicate-url-free-software/

Thanks man, this is what i'm looking for.
Cheers!

 

[jaikanth123]

Just go with fiverr they will surely help you how to remove duplicate domain

 

[popzzz]

Remove Duplicate URL ? Free Software
tipstrickstutorials.com/remove-duplicate-url-free-software/

My choice for this task! :thumb:

Virus Scan:
File name: Remove Duplicate URL.exe
Submission date: 2010-11-12 14:32:15 (UTC)
Current status: finished
Result: 0/ 43 (0.0%)

http://www.virustotal.com/file-scan/report.html?id=b5fed102a0d65dd2a0efb3fad0815758f9e30ed2b7425f277267bfa3435327b7-1289572335

------------------------------------------------------------
DISCLAIMER:
Although the author has courteously provided virus scan information for this post, it does NOT alleviate
any users from using appropriate virus software on their own computers and using such software prudently.

Two things are infinite: The universe and stupidity. I'm still not convinced of the universe.
------------------------------------------------------------

Enjoy .... :cool2:
​

 

[groggi42]

Remove Duplicate URL ? Free Software
tipstrickstutorials.com/remove-duplicate-url-free-software/

Nice tool for newbies like me. Simple and effective. Thank you.