1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

tool to remove duplicate keywords?

Discussion in 'Black Hat SEO' started by bobgoe, Feb 15, 2012.

  1. bobgoe

    bobgoe Power Member

    Joined:
    Sep 21, 2010
    Messages:
    652
    Likes Received:
    199
    I used to do manual keyword research using GKT (google keyword tool ) so i sort the kewords and download as text and add those keyword to GKT for even more narrow dig , and once ever thing is done i will be having a huge list of keyword for analysis but thing is that some of them are duplicate keyword so how to remove the duplicate keyword form the list. I am using notpad for text editing so is there an other tool that helps to remove duplicate keyword form the list .
     
  2. ksy213

    ksy213 Power Member

    Joined:
    Apr 24, 2011
    Messages:
    583
    Likes Received:
    152
    Scrapebox :)
     
  3. ferma231

    ferma231 Elite Member

    Joined:
    Jul 14, 2011
    Messages:
    1,698
    Likes Received:
    3,513
    Location:
    Internet
    Market samurai will do this for you
     
  4. bobgoe

    bobgoe Power Member

    Joined:
    Sep 21, 2010
    Messages:
    652
    Likes Received:
    199
    I am having scrape box but how do i do that with scrapebox , It will help only to harvest additional keyword which i don't want , I just want to remove the duplicate form the existing list. I am not having MS
     
  5. hellohellosharp

    hellohellosharp Power Member

    Joined:
    Dec 8, 2010
    Messages:
    625
    Likes Received:
    552
    Occupation:
    CEO @ CLEANFILES LLC
    Location:
    USA
    Home Page:
    Just copy and paste into here:

    Code:
    http://textmechanic.com/Remove-Duplicate-Lines.html
     
    • Thanks Thanks x 3
  6. ActionTaker

    ActionTaker Power Member

    Joined:
    Jun 11, 2011
    Messages:
    606
    Likes Received:
    210
    Excel
     
  7. bobgoe

    bobgoe Power Member

    Joined:
    Sep 21, 2010
    Messages:
    652
    Likes Received:
    199
    Thanks you saved my day it worked like a charm made my life lot easier
     
  8. hotohori

    hotohori Newbie

    Joined:
    Dec 6, 2009
    Messages:
    43
    Likes Received:
    16
    Or Calc from Open Office (free).
     
  9. latinofever

    latinofever Junior Member

    Joined:
    Mar 27, 2011
    Messages:
    190
    Likes Received:
    26
    Location:
    Planet Earth
    Home Page:
    In scrapebox use Dups button on left hand side to remove duplicate keywords fast.

    Sent from my GT-I9100 using Tapatalk
     
  10. restinpeace

    restinpeace Newbie

    Joined:
    Apr 29, 2010
    Messages:
    23
    Likes Received:
    0
    great link hellohellosharp. this is what im searching . i always do that in console with folowing command : sort file | uniq > file.new
     
  11. restinpeace

    restinpeace Newbie

    Joined:
    Apr 29, 2010
    Messages:
    23
    Likes Received:
    0
    forgot to say , i use unix for this. only using windows for browsing and do some work :)
     
  12. Risaharada

    Risaharada Junior Member

    Joined:
    Oct 27, 2010
    Messages:
    105
    Likes Received:
    30
    You need to own scrapebox, its addons are really very helpful for your seo work.
     
  13. arnold81

    arnold81 Newbie

    Joined:
    Jan 6, 2010
    Messages:
    15
    Likes Received:
    0
    I like this feature in scrapebox, excel is good as well
     
  14. bobgoe

    bobgoe Power Member

    Joined:
    Sep 21, 2010
    Messages:
    652
    Likes Received:
    199

    I have scrape box but it will not sort if you just want to sort from existing keyword it will sort and remove duplicate keywords only if we use it to scrape keyword
     
  15. rosoma

    rosoma Newbie

    Joined:
    Jul 21, 2011
    Messages:
    38
    Likes Received:
    9
    I use PilotEdit to dedupe 20milion lines. and works fast. I use the trail version
     
  16. TrollDad

    TrollDad Regular Member

    Joined:
    Jul 5, 2012
    Messages:
    257
    Likes Received:
    62
    excel can do this shit perfectly for you, support up to 1M lines(excel2010)
     
  17. Aty

    Aty Jr. VIP Jr. VIP

    Joined:
    Jan 27, 2011
    Messages:
    5,777
    Likes Received:
    3,958
    Home Page: