Remove Duplicates Tool

Proxy Cake

Elite Member

Jr. VIP

Feb 28, 2010

5,501

4,420

• Jan 29, 2011

• #1

Hey guys. I have 2 email lists and I want to remove the duplicates. Is there any tool I can use to do this?

 

cyberzilla

Elite Member

Nov 15, 2009

2,467

3,599

• Jan 29, 2011

• #2

Try this

Code:

http://www.brothersoft.com/remove-%28delete%29-duplicate-email-addresse-126183.html

or else you can do that manually using excel. Here is the step-by-step instruction

Code:

http://www.digdb.com/excel_add_ins/duplicates_find_remove_dedupe/

 

Last edited: Jan 29, 2011

kkvsam

Senior Member

Oct 11, 2009

938

570

• Jan 29, 2011

• #3

Try this . works perfectly...

Code:

http://www.mediafire.com/?q9ui54ebabsw1uz

VT

Code:

http://www.virustotal.com/file-scan/reanalysis.html?id=6932267da6141f3fd306c7f695652589828fba9882628d188c3dd298943b4e04-1296312178

 

Last edited: Jan 29, 2011

cyberzilla

Elite Member

Nov 15, 2009

2,467

3,599

• Jan 29, 2011

• #4

@kkvsam Please add VT scan if it is an exe file

 

kkvsam

Senior Member

Oct 11, 2009

938

570

• Jan 29, 2011

• #5

cyberzilla said:

@kkvsam Please add VT scan if it is an exe file

Click to expand...

Thanks uploading!!!!!
done...

 

Last edited: Jan 29, 2011

F

f0rked

Registered Member

Jan 25, 2009

71

64

• Jan 29, 2011

• #6

Code:

#!/usr/bin/perl

use strict;
use warnings;

my $file = 'email.txt';
my %seen = ();
{
   local @ARGV = ($file);
   local $^I = '.bac';
   while(<>){
      $seen{$_}++;
      next if $seen{$_} > 1;
      print;
   }
}
print "finished processing file.";

Simple, clean, and fast.

 

Proxy Cake

Elite Member

Jr. VIP

Feb 28, 2010

5,501

4,420

• Jan 29, 2011
• Thread Starter Thread Starter

• #7

kkvsam said:

Try this . works perfectly...

Code:

http://www.mediafire.com/?q9ui54ebabsw1uz

VT

Code:

http://www.virustotal.com/file-scan/reanalysis.html?id=6932267da6141f3fd306c7f695652589828fba9882628d188c3dd298943b4e04-1296312178

Click to expand...

How do I use this man? I'm baked and cant figure it haha

 

M

mr285

Newbie

Jul 21, 2010

16

4

• Jan 29, 2011

• #8

This is what i've been using. So far so good:
textop[dot]us/Lines-tools/Delete-Duplicate-Lines

Obviously replace [dot] with "."

 

F

f0rked

Registered Member

Jan 25, 2009

71

64

• Jan 29, 2011

• #9

Make a new file and name it whatever you'd like, say removedupes.pl, download ActivePerl(google it), and place your list(name it emails.txt) in the same location as the removedupes.pl file, and run removedupes.pl. That simple. Your file with dupes removed will still be labeled emails.txt, and you'll have a new file named emails.bac, which contains the old list before the dupes were removed.

PornMan said:

I would love to know how to use this...do I have to make a p hp fi le, add this code to it, upload it to my server, open it and then add my em a ils???

Click to expand...

 

Last edited: Jan 29, 2011

kkvsam

Senior Member

Oct 11, 2009

938

570

• Jan 29, 2011

• #10

facebookdude said:

How do I use this man? I'm baked and cant figure it haha

Click to expand...

extract rar file and run the exe file. then click "email list" tab and import emails.then click the "clean list" button. If you want to compare another email list, click the tab of "Remove list" and import that list to it. Then click "email list" tab and then click "clean list" button .

Very easy...

 

BH_Manic

Junior Member

Aug 28, 2009

158

719

• Jan 30, 2011

• #11

I guess SB can do. Just copy-paste that list to keyword scrapper and remove duplicates.

 

ericsson

Elite Member

Apr 25, 2009

2,640

8,233

• Jan 30, 2011

• #12

Use this man.


Send-Safe List Manager

 

soulless1

Regular Member

Aug 20, 2009

245

93

• Jan 31, 2011

• #13

I have used this skymem(Dot)com