1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

URL List Editor Needed

Discussion in 'Black Hat SEO Tools' started by TragikGod, Sep 26, 2014.

  1. TragikGod

    TragikGod Registered Member

    Joined:
    Mar 13, 2014
    Messages:
    84
    Likes Received:
    25
    Occupation:
    Full-time Student
    Location:
    United States
    If someone can help me with this I would be VERY appreciative.

    I'm hoping someone can help me out with a program that is powerful enough to...
    1. Load a URL list. (List 1)
    2. Load a 1mill+ URL list. (List 2)
    3. Remove (List 2) from (List 1)
    4. Save (List 3) which is (List 1 - List 2) = List 3

    OR

    Something like Scrapebox's exclude list but on a bigger scale.

    I looked all over the internet only to find editiors that just find the difference and highlight it and UNIX stuff.

    Thank you in advance.
     
  2. RedLable

    RedLable Regular Member

    Joined:
    Feb 16, 2011
    Messages:
    244
    Likes Received:
    32
    Ubot can do this, might have to make the larger list smaller depending on the memory your computer has tho.
     
  3. fatboy

    fatboy Elite Member

    Joined:
    Aug 13, 2008
    Messages:
    1,618
    Likes Received:
    3,227
    Occupation:
    Retired
    Location:
    Old Peoples Home
    What do you want it written in - Ubot in its default form will most definitely choke and die if you throw that many links at it at one go, perhaps with the decent plugins it may work.

    If you want to run scripts on Linux, then Perl will do it in a heartbeat....

    Give more details and you will probably get better answers :)
     
  4. Conor

    Conor Jr. VIP Jr. VIP

    Joined:
    Nov 7, 2012
    Messages:
    3,364
    Likes Received:
    5,425
    Gender:
    Male
    Location:
    South Africa
    Home Page:
    • Thanks Thanks x 2
  5. Asif WILSON Khan

    Asif WILSON Khan Executive VIP Premium Member

    Joined:
    Nov 10, 2012
    Messages:
    10,124
    Likes Received:
    28,566
    Gender:
    Male
    Occupation:
    Fun Lovin' Criminal
    Location:
    London
    Home Page:
    • Thanks Thanks x 2
  6. WMAid

    WMAid Newbie

    Joined:
    Sep 9, 2014
    Messages:
    45
    Likes Received:
    2
    Home Page:
    I have one simple script which all my friends and me use very often.

    Free. Open Source
    bit.ly/1voiZU5

    you need to install python 2.7 on your machine to run it.

    Script works with 3 files
    • i.txt - input data
    • d.txt - delete from input data
    • o.txt - output data

    Also it can delete not unique lines.
     
  7. Stevenlarsen

    Stevenlarsen Regular Member

    Joined:
    Nov 3, 2013
    Messages:
    319
    Likes Received:
    89
    I will help you,Check your skype.
     
  8. Asif WILSON Khan

    Asif WILSON Khan Executive VIP Premium Member

    Joined:
    Nov 10, 2012
    Messages:
    10,124
    Likes Received:
    28,566
    Gender:
    Male
    Occupation:
    Fun Lovin' Criminal
    Location:
    London
    Home Page:

    It is against the rules to link directly to a download and hide the link with a URL shortener and you also need to provide a VirusTotal report

    https://www.virustotal.com/en-gb/fi...1ce9e82fedb5a06ddae2ce76/analysis/1411812007/
     
  9. WMAid

    WMAid Newbie

    Joined:
    Sep 9, 2014
    Messages:
    45
    Likes Received:
    2
    Home Page:
    Thanks for the virus total report.
    I'm newbie here and still can't pos tnormal links. URL shortener helped me to help topic starter.
    I don't mind if moderators will remove or change my link.
     
    • Thanks Thanks x 1
  10. Asif WILSON Khan

    Asif WILSON Khan Executive VIP Premium Member

    Joined:
    Nov 10, 2012
    Messages:
    10,124
    Likes Received:
    28,566
    Gender:
    Male
    Occupation:
    Fun Lovin' Criminal
    Location:
    London
    Home Page:
    No problem Mate, thanks for sharing but just familiarise yourself with the Download rules
    http://www.blackhatworld.com/blackhat-seo/f29-member-downloads/
     
  11. gary2

    gary2 Jr. VIP Jr. VIP Premium Member

    Joined:
    Jan 20, 2013
    Messages:
    971
    Likes Received:
    82
    Occupation:
    Inbound Marketer. Blogger. Author.
    Location:
    Near River
    even i will suggest Ubot like redlable... dependable and good service
     
  12. misteryou.

    misteryou. Power Member

    Joined:
    Feb 1, 2012
    Messages:
    573
    Likes Received:
    109
  13. Xtremerank

    Xtremerank Newbie

    Joined:
    Aug 15, 2014
    Messages:
    41
    Likes Received:
    21
    Location:
    Skype: Xtremerank
    Home Page:
    Excel is limited to 1m rows unfortunately :(
    TextFX is awesome though, recommended!
     
    • Thanks Thanks x 1