1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

help needed: combine csv's + delete duplicates

Discussion in 'Making Money' started by Danman123, Mar 27, 2017.

  1. Danman123

    Danman123 Regular Member

    Joined:
    Jul 23, 2016
    Messages:
    201
    Likes Received:
    37
    Gender:
    Male
    Does anyone know a tool that can do as described in the title? I have a few csv's with over 1.5 million email adresses. But i want to clean them up a bit.
     
  2. sysco32

    sysco32 Jr. VIP Jr. VIP

    Joined:
    Feb 5, 2014
    Messages:
    609
    Likes Received:
    226
    Location:
    Skopje/Pecs
    Try the program csvsplitter.I used it before and it is good.
     
  3. rafark

    rafark Regular Member

    Joined:
    Jan 15, 2013
    Messages:
    439
    Likes Received:
    221
    Gender:
    Male
    Occupation:
    Moderador
    Location:
    Noble and Heroic MC
    If you're a programmer you can export it to a local sql database (using LOAD DATA INFILE) do your stuff in SQL and then export it. That's what I did just a couple a weeks ago for a client. Very handy, if you know SQL.
     
  4. hackedd

    hackedd Junior Member

    Joined:
    Aug 11, 2010
    Messages:
    143
    Likes Received:
    173
    Gender:
    Male
    I can do it for you for a couple of bucks. Let me know if interested...
     
  5. deal with it

    deal with it Power Member

    Joined:
    Sep 30, 2015
    Messages:
    629
    Likes Received:
    278
    Gender:
    Male
    use ABLEBITS
     
  6. Danman123

    Danman123 Regular Member

    Joined:
    Jul 23, 2016
    Messages:
    201
    Likes Received:
    37
    Gender:
    Male
    thanks!
     
  7. uncutu

    uncutu Elite Member

    Joined:
    Aug 6, 2010
    Messages:
    1,639
    Likes Received:
    846
    hire va to do it for you or try manually with notepad++ with textFX plugin to remove dupes and Merge plugin to merge multi files into 1 file.
     
  8. mainceaft

    mainceaft Regular Member

    Joined:
    Apr 10, 2013
    Messages:
    391
    Likes Received:
    40
    1 million Is huge amount of lines it's very hard to doing it manually . I can develop PHP secript do the Job , id you hire me I will give your the source code of the script so you can us it lather .