Remove root urls from a big list

[adward]

I think there is no way to remove root urls using Scrapebox. I don't know which tool can help? Thanks for your input.

 

[philionaire]

why not put list into note pad.

replace URL with nothing (leave blank)

HTH

 

[adward]

why not put list into note pad.

replace URL with nothing (leave blank)

HTH

Maybe you don't get my point. Say you scrape a big list and don't want to waste time posting on root urls. I don't think notepad can help in this case.

 

[sfidirectory]

If you know PHP, Java or Javascript programming you could use a regular expression to just output non-root urls to the screen? If you can give me some examples of your problem maybe I can code something up if I have time .

 

[philionaire]

Maybe you don't get my point. Say you scrape a big list and don't want to waste time posting on root urls. I don't think notepad can help in this case.

Ah, sorry, not sure how to do that. I usually look at peoples posts/time theyve been here before commenting, but this time I never. If I had, I doubt I would have replied as im sure you know how to do more than most.

Thought it was a simple problem with a simple solution > on to the programmers!

 

[Busrunner]

If you know PHP, Java or Javascript programming you could use a regular expression to just output non-root urls to the screen? If you can give me some examples of your problem maybe I can code something up if I have time .

I tried it in excel without VBA, but it was a bit too tacky, because h there could be subdomains and TLD's with longer extensions. But yeah, build a script for it. Wth some search you can find a list with most common extensions like .com, .co.uk, .net, etc. Ten the rest is easy.

 

[wannabie]

text to columns? in excel?

 

[Busrunner]

text to columns? in excel?

With what seperator? A dot?
What happens to:
Google.com
Www.google.co.uk

 

[SEOWhizz]

I think there is no way to remove root urls using Scrapebox.

The Hi Speed Duplicate domain and Root url remover should help:

http://scrapeboxmarketplace.com/scrapebox-helper-tools

:smokin:

 

[sfidirectory]

I tried it in excel without VBA, but it was a bit too tacky, because h there could be subdomains and TLD's with longer extensions. But yeah, build a script for it. Wth some search you can find a list with most common extensions like .com, .co.uk, .net, etc. Ten the rest is easy.

I see SEOWhizz has provided a tool that could simply do this for you, it might be worth checking out . Am not sure if I will do the script today as I've got to do some I.M work on one of my sites and then do a massive cleanup of my hard drives - have got shares from here that havnt been touched in over 3 months lol.

To do such a script wouldn't be too hard... All the script needs to do is to read lines from a file (.txt files would be simpler), check if the regex matches that line (in this case a URL - regex formatted to block root urls as requested) and then output all non-root urls to another file or the screen (if you are copying and pasting the urls into a textfield).

 

[adward]

The Hi Speed Duplicate domain and Root url remover should help:

http://scrapeboxmarketplace.com/scrapebox-helper-tools

:smokin:

Thanks mate. This will be really helpful for me. Cheers.

 

[SEOWhizz]

Hey guys,

I tried the link above and I didn't receive the tool, so I contacted MAtt aka loopline. He very kindly provided the following links:

Scrapebox Classroom Domain Cleaner:
Allows you to keep only a certain number of urls from a given domain, so you don't over spam that domain. Also allows you to remove root urls from your list.

Tutorial:
http://www.youtube.com/watch?v=j6znY88iOqs

Download:

http://www.scrapeboxclassroom.com/tools/scrapebox-classroom-domain-cleaner.zip

Thanks MAtt

 

[wannabie]

With what seperator? A dot?
What happens to:
Google.com
Www.google.co.uk

Trailing slash normally works considering sb spits out http:// and most sites structure pages with / then all you need to do is remove duplicates, a 5 minute job