1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How Can I Remove Just "http://www." From A List Of URLs

Discussion in 'BlackHat Lounge' started by oni3350, Apr 8, 2010.

  1. oni3350

    oni3350 Regular Member

    Joined:
    Sep 24, 2008
    Messages:
    361
    Likes Received:
    194
    Occupation:
    Internet Marketer/ Black Hatter
    Location:
    Perth, Western Australia
    Home Page:
    I have a bulk list of URLs.

    But i need to be able to remove just the "http://www." part of them.

    How can i do this with a small script or even maybe with excel or something?
     
  2. macpaulos

    macpaulos Regular Member

    Joined:
    Oct 14, 2009
    Messages:
    295
    Likes Received:
    53
    Copy the list into notepad, use "replace" under the edit menu. Put http://www into the "Find what" field and leave "replace with" blank.

    Done! :)
     
  3. otaku3230

    otaku3230 Registered Member

    Joined:
    Aug 8, 2009
    Messages:
    63
    Likes Received:
    3
    Just use the replace function in Excel. Press Ctrl + H

    Type http://www. in Find what
    Leave Replace with blank

    That's it.
     
  4. falconer

    falconer Registered Member

    Joined:
    Dec 17, 2009
    Messages:
    92
    Likes Received:
    116
    Try alphabetizer dot flap dot tv
     
  5. krocks

    krocks Registered Member

    Joined:
    Feb 4, 2008
    Messages:
    59
    Likes Received:
    11
    Just copy it in notepad.
    Open the Find /Replace option.
    Find: http://www.
    Replace: {**Leave this blank**}

    and you're done. :)
     
  6. Tinus

    Tinus Registered Member

    Joined:
    Mar 4, 2009
    Messages:
    54
    Likes Received:
    19
    I have a similar question.

    Let say I have a list like this:

    www.abc.com
    www.ble.com
    etc.etc.etc.

    How do I make of all those URLS, an proper html link tag, I mean like tis
    <a href="www.abc.com">XX</a>
    <a href="www.bleh.com">XX</a>

    I dont want to do it manually as I have a list of 10000.....
     
  7. oni3350

    oni3350 Regular Member

    Joined:
    Sep 24, 2008
    Messages:
    361
    Likes Received:
    194
    Occupation:
    Internet Marketer/ Black Hatter
    Location:
    Perth, Western Australia
    Home Page:
    OMG no shit!.... haha cant believe i did not think of that before. Thanks.

    Ok heres another small problem. Does anyone know how i can just grab the URLS from a block of HTML code. I need to filter out everything but the URL addresses which are inside two of these like " url address"
     
  8. hpv222

    hpv222 Power Member

    Joined:
    Feb 8, 2010
    Messages:
    736
    Likes Received:
    274
    google url extractor - there used to be free ones, otherwise it can be done with regular expressions, but that's hardcore ;))
     
  9. kaidoristm

    kaidoristm Power Member

    Joined:
    Feb 13, 2009
    Messages:
    561
    Likes Received:
    726
    Occupation:
    Freelancer
    Location:
    Estonia
    Home Page:
    Somethink like this could help

    PHP:
    <?php

    $location 
    "http://www.somelink.com";

    preg_match_all('|href="(.*?)"|',file_get_contents($location),$matches);

    foreach(
    $matches[1] as $key => $value)
    {
        if(
    strpos($value,"http:") !== false)
        {
            echo 
    '<a target="_blank" href="'.$value.'">'.$value.'</a><br />';
        }
    }

    ?> 
     
    • Thanks Thanks x 3
  10. oni3350

    oni3350 Regular Member

    Joined:
    Sep 24, 2008
    Messages:
    361
    Likes Received:
    194
    Occupation:
    Internet Marketer/ Black Hatter
    Location:
    Perth, Western Australia
    Home Page:
    nice, this works pretty good. Thank you.

    Wish i knew PHP, it would come in handy SOOOOO much!
     
  11. kaidoristm

    kaidoristm Power Member

    Joined:
    Feb 13, 2009
    Messages:
    561
    Likes Received:
    726
    Occupation:
    Freelancer
    Location:
    Estonia
    Home Page:
    Glad you found it useful :)
     
  12. Cinforce

    Cinforce Registered Member

    Joined:
    May 23, 2009
    Messages:
    95
    Likes Received:
    45
    WE GET IT
    How many times does someone have to explain the same thing? It's not like he's not reading the first one.
    "DURR OPEN NOTEPAD AND DO REPLACE"
    "YE OR WITH WORDPAD"
    "YE OR EXCEL"
    "YE OR +1 POSTCOUNT"
     
  13. oni3350

    oni3350 Regular Member

    Joined:
    Sep 24, 2008
    Messages:
    361
    Likes Received:
    194
    Occupation:
    Internet Marketer/ Black Hatter
    Location:
    Perth, Western Australia
    Home Page:
    lol funny ^^^^^^

    but not to be offensive to the other suggestions of how to do it, its kinda true.
     
  14. otaku3230

    otaku3230 Registered Member

    Joined:
    Aug 8, 2009
    Messages:
    63
    Likes Received:
    3

    Very easy. Use Excel and do as below;

    Type <a href=" in column A
    Type www.abc.com in column B
    Type ">XX</a> in column C

    Now type this formula in column D =A1&B1&C1
    It will concatenate all the values. You can do this for thousands of values at a time.

    Any problem, reply here.
     
    • Thanks Thanks x 1
  15. oni3350

    oni3350 Regular Member

    Joined:
    Sep 24, 2008
    Messages:
    361
    Likes Received:
    194
    Occupation:
    Internet Marketer/ Black Hatter
    Location:
    Perth, Western Australia
    Home Page:
    Yeah but if you had thousands of rows how can you apply that one code to like 1000 rows at once?

    i can only see this working if i were to place this code inside column D for each and every row MANUALLY.
     
  16. krocks

    krocks Registered Member

    Joined:
    Feb 4, 2008
    Messages:
    59
    Likes Received:
    11
    An easy way to do is
    :
    Find: www.
    Replace with: <a href="http://www.

    Then Find: .com
    Replace with: .com">XX</a>

    Use notepad! simple and easy! :)
     
  17. The Captain

    The Captain Regular Member

    Joined:
    Sep 12, 2009
    Messages:
    343
    Likes Received:
    188
    load the urls in scrapebox and save as html links
     
  18. The Scarlet Pimp

    The Scarlet Pimp Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 2, 2008
    Messages:
    788
    Likes Received:
    3,129
    Occupation:
    Chair moistener.
    Location:
    Cyberspace

    except you won't know where the links lead, you'll have a page like this:

    <a href="http://www.bodygrease.us">XX</a>

    <a href="http://www.shoplifters.com">XX</a>

    <a href="http://www.diznee.biz">XX</a>

    <a href="http://www.cargopants.cc">XX</a>

    <a href="http://www.nehrujackets.org">XX</a>

    <a href="http://www.bademosongs.net">XX</a>

    a bit confusing, until you go thru all of the code and replace every 'XX' with the actual url.
     
  19. iglow

    iglow Elite Member

    Joined:
    Feb 20, 2009
    Messages:
    2,080
    Likes Received:
    856
    Home Page:
    notepadd++ ctrl+h change to nothing
     
  20. Standard Toaster

    Standard Toaster Regular Member

    Joined:
    Aug 29, 2009
    Messages:
    335
    Likes Received:
    190
    Just drag the "code" down... Put cursor on the lower right corner, a plus sign would appear, just double click or drag it down.

    Learn atleast basics of excel man, it will help you in the long run.
     
    • Thanks Thanks x 1