Remove bah from url ?

L

lifco

Regular Member

Apr 5, 2010

206

284

• Mar 24, 2011

• #1

Guys is there anyway to remove the crap after the main url

like this http://www.whatever.com/blog bah bah,
so it just leave this http://www.whatever.com

Thanks its coz ive got a big list that needs sorting

 

xpleet

Regular Member

Jan 18, 2010

383

332

• Mar 24, 2011

• #2

Replace "blah" using notpad or notpad++ with empty.
You can also filter it with scrapebox.

 

fatboy

Elite Member

Aug 13, 2008

1,615

3,262

• Mar 24, 2011

• #3

If you can run PHP, take a look at http://us.php.net/manual/en/function.parse-url.php
That should sort you out in a few minutes.

 

snoozebot

Power Member

Nov 1, 2010

538

513

• Mar 24, 2011

• #4

I'd use Notepad and replace the '/bah' with nothing if I were you.

 

GreyWolf

Elite Member

Aug 17, 2009

1,862

5,847

• Mar 24, 2011

• #5

snoozebot said:

I'd use Notepad and replace the '/bah' with nothing if I were you.

Click to expand...

since the /blah blah blah part won't be the same for every line, the search and replace in notepad won't help him. Unless he wants to just go through manually removing it line by line. I think he'd rather it be automated.

The PHP solution fatboy suggested is a better way. He can use the function to parse through the lines to find something like the third slash and remove everything after that till the next line and keep repeating the task for each line until the eof. The script can parse through the first file and write a new file with the data cleaned up in the way the OP wants it.


:call2:

 

Last edited: Mar 24, 2011

RandomPhantom

Regular Member

Nov 7, 2008

252

136

• Mar 24, 2011

• #6

Try CSVed

Open it as a CSV-file, set the delimiter to " " (space) and delete column 2 and you're all set.

 

snoozebot

Power Member

Nov 1, 2010

538

513

• Mar 24, 2011

• #7

GreyWolf said:

since the /blah blah blah part won't be the same for every line, the search and replace in notepad won't help him. Unless he wants to jsut go through manually removing it line by line. I think he'd rather it be automated.

Click to expand...

Ha..missed the blah blah part. I just saw the title (mentioning /bah) and the link that ends with /blog. I figured /bah = /blog. Didn't notice there's more after the /blog. Yeah using notepad in that case would be stupid.

 

L

lifco

Regular Member

Apr 5, 2010

206

284

• Mar 24, 2011
• Thread Starter Thread Starter

• #8

Thanks guys for the help, yer il give the php way a shot

 

fatboy

Elite Member

Aug 13, 2008

1,615

3,262

• Mar 24, 2011

• #9

This should work:

Code:

<?php

        $urls = file('urls.txt');
        foreach($urls as $url)
        {
                print "http://" . parse_url($url, PHP_URL_HOST) . "\n";
        }
?>

Just put all your urls in urls.txt, one per line then run the script.


** EDIT **
If you want the URLs in another file then do:

Code:

php scriptname.php > output.txt

 

Last edited: Mar 24, 2011