Link scraping question

J

jackfitz

Newbie

May 2, 2009

27

2

• Jun 9, 2010

• #1

I am scraping wordpress blogs. This generates a list of URLS which are not the top domain e.g. http://www.someblog.com. they are posts e.g. http://www.somblog.com/somepost.php what is the best way to remove the /some post from the url so I am left with just the domain http://www.somedomain.com
The reason is I can then run them through a pr checker.

 

L

lincolnave

Regular Member

Dec 5, 2008

389

186

• Jun 11, 2010

• #2

I believe scrape box does this, or something like it. Check it out.

 

suzieq

Junior Member

Sep 2, 2009

115

16

• Jun 22, 2010

• #3

Scrapebox will do it - I can do it for you if you want to pm me the list.
Otherwise you can probably manipulate the data fairly simply in a spreadsheet.

 

J

jackzard

Newbie

Dec 23, 2009

8

1

• Jun 22, 2010

• #4

for better maybe use delete domain,. scrape box can do that

 

H

haverox

Regular Member

Oct 6, 2009

279

150

• Jul 19, 2010

• #5

Just click on trim to root