Scrapebox Question - How To Filter Out Certain Domains In List

HelloInsomnia

Elite Member

Mar 1, 2009

1,801

3,042

• Nov 16, 2010

• #1

Basically I want to take a large list and filter out all the sites that are from certain domains such as:

Code:

http://en.wikipedia.org
http://www.youtube.com

How do I do this with a list I've already scraped, is there a way to check it against my local blacklist file?

Also, is there a way to filter out domains that are root in my list as well, I only want inner pages..

 

andreyg13

Senior Member

Nov 13, 2009

915

1,792

• Nov 16, 2010

• #2

just add them to local blacklist file

 

bakxos

Regular Member

Aug 8, 2010

498

292

• Nov 16, 2010

• #3

You import the first list. You then select import and you choose the option import and compare on domain level. You browse your folders and select the file with all the domains you do not want to your list to contain. You import and you are done.

 

HelloInsomnia

Elite Member

Mar 1, 2009

1,801

3,042

• Nov 16, 2010
• Thread Starter Thread Starter

• #4

Ah I see, after adding it I had to clear the list and reload it. Okay that takes care of that but what about filtering out only root domains and keeping inner pages?

 

bakxos

Regular Member

Aug 8, 2010

498

292

• Nov 16, 2010

• #5

thats a bit more complicated.
1.you import the list of urls which you want the root domain to exclude
2.You press trim to root and you get all the root domains(if you already have the root domain skip these steps).
3.You save the root domains.
4.You import the urls that you want to use
5.You press import and then choose import and compare on url level.
6.You browse the url list of the root domains you want to exclude and you are done.

 

pisco

Regular Member

Aug 13, 2010

223

44

• Nov 16, 2010

• #6

Have you tried you putting in the footprint -"hxxp://whatever.com" ?, I use a similar footprint to remove any results that include closed comment blogs.

**EDIT**

My bad, this doesn't do much for you since you already scraped the url's, but still might be helpful to someone who wants to filter out specific domains

 

Last edited: Nov 16, 2010

HelloInsomnia

Elite Member

Mar 1, 2009

1,801

3,042

• Nov 16, 2010
• Thread Starter Thread Starter

• #7

bakxos said:

thats a bit more complicated.
1.you import the list of urls which you want the root domain to exclude
2.You press trim to root and you get all the root domains(if you already have the root domain skip these steps).
3.You save the root domains.
4.You import the urls that you want to use
5.You press import and then choose import and compare on url level.
6.You browse the url list of the root domains you want to exclude and you are done.

Click to expand...

I don't know the domains I just want to filter out any root domain if that's possible. If not I suppose I can throw it in excel and sort it by length and do it that way.

 

bakxos

Regular Member

Aug 8, 2010

498

292

• Nov 16, 2010

• #8

its quite simple.

Import the list you want and press trim to root.
Save the trimmed list.
Import again the first list.
Then choose import and compare urls and browse to the trimmed to root list (step 1 and 2).
You are done.