1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

remove lines with duplicate keywords scrapebox

Discussion in 'Black Hat SEO' started by dllll, Jan 17, 2015.

  1. dllll

    dllll Registered Member

    Joined:
    Jun 20, 2014
    Messages:
    89
    Likes Received:
    43
    So i just scraped a list of 10K Keywords, scrapebox has an option to delete duplicate lines but i want to delete any line with 2 or more duplicate words, does anyone know how to do this?

    so these keywords here for example
    Code:
    abc electronics address
    abc electronics sales
    abc electronics black friday
    electronics ps4
    electronics ps3
    it should look like this after deleting lines with 2 or more duplicate keywords
    Code:
    abc electronics address
    electronics ps4
    electronics ps3
    
     
  2. AmateRasu

    AmateRasu Power Member

    Joined:
    Nov 12, 2013
    Messages:
    763
    Likes Received:
    429
    Location:
    Manila,Philippines
  3. dllll

    dllll Registered Member

    Joined:
    Jun 20, 2014
    Messages:
    89
    Likes Received:
    43
  4. THUNDERELVI

    THUNDERELVI Elite Member

    Joined:
    Sep 12, 2009
    Messages:
    2,547
    Likes Received:
    2,200
    Gender:
    Male
    Location:
    W3
    Your only bet I think is to use a regular expression and apply it to a text editor that supports regex such as Notepad++.
     
  5. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,874
    Likes Received:
    2,057
    Gender:
    Male
    Home Page:
    I can tell you Scrapebox will not do it, and I concur with the above post, Regex is probably your best bet.
     
    • Thanks Thanks x 1
  6. TextMechanic

    TextMechanic Newbie

    Joined:
    Nov 7, 2014
    Messages:
    3
    Likes Received:
    9
    Home Page:
    Built the tool and I hope it helps. It does exactly what you specified.

    Being a newbie the forum won't let me post a url, so prefix the text below with my domain and suffix with html.

    Remove-Lines-with-Duplicate-Phrases

    p.s. If someone would post the link, I would be very thankful.
     
    • Thanks Thanks x 2
  7. bokeboke

    bokeboke Junior Member

    Joined:
    Mar 21, 2010
    Messages:
    132
    Likes Received:
    31

    whoooooooooooooooooops
     
    Last edited: Jan 18, 2015
  8. RedLable

    RedLable Regular Member

    Joined:
    Feb 16, 2011
    Messages:
    244
    Likes Received:
    32
  9. THUNDERELVI

    THUNDERELVI Elite Member

    Joined:
    Sep 12, 2009
    Messages:
    2,547
    Likes Received:
    2,200
    Gender:
    Male
    Location:
    W3
    WOW that was fast. Are you the owner of textmechanic ? Assuming from the username you seem to be.
    You have a wonderful site in there, I use it almost everyday and has saved me a lot of time.
     
  10. rob1977

    rob1977 Power Member

    Joined:
    Mar 25, 2013
    Messages:
    775
    Likes Received:
    676
    That is a pretty awesome site text mechanic.

    :cool:
     
  11. dllll

    dllll Registered Member

    Joined:
    Jun 20, 2014
    Messages:
    89
    Likes Received:
    43
    Hey youre awesome! I feel honored you took the time to build that tool for free you just saved me alot of time.
     
  12. dllll

    dllll Registered Member

    Joined:
    Jun 20, 2014
    Messages:
    89
    Likes Received:
    43
    Not working anymore why did you remove it?