BIG Problem with ScrapeBox and remove duplicate domains

blackhaze · Mar 16, 2011

So i have a bunch of lists, and they contain many URLs with blog pages, eg.

blog .com/post1.html
blog .com/post2.html
blog .com/post3.html (<- ALL the same domain here)

Since i don't want to spam my links many times to the SAME domain i click "remove duplicate domains".

But Scrapebox trims the result to root domain, leaving then only
blog .com

PROBLEM: blog.com is the main URL and not a sub-URL where i can post comments!

So every time when i "remove duplicate domain" it removes/filters the actual post/comment URLs and leaves only the main URL at the end and i cannot post to that!

Maruk · Mar 16, 2011

It seems that of clicking the dropdown button, you actually click the "Trim to root" button that is positioned exactly underneath the "Remove duplicate domains" button.

Check that out.

jheyslow · Mar 16, 2011

Maruk said:
It seems that of clicking the dropdown button, you actually click the "Trim to root" button that is positioned exactly underneath the "Remove duplicate domains" button.

Check that out.

I second to that. OP clearly click the "trim to root" not the "Remove duplicate domains". Please check it again op.

Maruk · Mar 16, 2011

Well, actually if the "Remove" menu expands, the button OP is looking for lays ontop of "Trim to Root".
So it is either a mistake on his part or a bug in SB that makes him click the wrong button.

Kickflip · Mar 16, 2011

OR scrapebox is using the shortest entry available when it removes duplicate domains, so if the root domain is listed in the list of blogs, it will choose to keep the root domain instead of one of the postable pages.

The only solution I can think of is to use the option which says like "Remove URLs not Containing" and remove any domains which don't have .html on the end if all the pages have .html. You can do the same with .php and combine the 2 filtered lists together after if needed. I guess theoretically you could do the same with ".com/" ".net/" ".org/" ".info/" because scrapebox doesn't display root domains with a trailing / after the tld.

blackhaze · Mar 16, 2011

guys, i am NOT retarded. I didnt click "trim to root".

This (unwanted) trim happens not with all domains, i dont know what the criteria is.
Kickflip, might check into this...sounds reasonable.

andreyg13 · Mar 16, 2011

Instead why don't you check for pr first and then go for the option: split duplicate domains. Then you should have several files each with unique domains.

If you ask why check for pr, this is because it will split the high pr ones first and so on.

scott8610 · Mar 16, 2011

Yeah what Kickflip said. Since the urls are organized by name the domain homepage is usually put before the other urls and scrapebox will only keep the first url when removing dupe domains. Not sure exactly how to get around this but that's the problem.

lacy1978 · Mar 16, 2011

You have the latest version of SB? Did this just start happening?

HoNeYBiRD · Mar 16, 2011

you can do this w/o SB easily, just check out this thread by crazyflx:

Code:

http://www.blackhatworld.com/blackhat-seo/black-hat-seo-tools/251546-have-over-1-million-urls-need-remove-duplicate-urls-domains-here-you-go.html

BIG Problem with ScrapeBox and remove duplicate domains

blackhaze

Power Member

Maruk

Power Member

jheyslow

BANNED

Maruk

Power Member

Kickflip

BANNED

blackhaze

Power Member

andreyg13

Senior Member

scott8610

Junior Member

lacy1978

Junior Member

HoNeYBiRD

Elite Member

Main Menu

Marketplace

Making Money

BlackHat World