Scrapebox - Do you remove duplicate domain or urls?
- Thread starter macdonjo3
- Start date
G0D0VERY0U
Regular Member
- Apr 6, 2010
- 439
- 284
BE - all urls
WP - all domains
WP - all domains
RankWithShelly
Elite Member
- May 4, 2010
- 1,503
- 314
Depends on why I'm harvesting. I harvest for many different purposes. Generally I just get rid of duplicate URLs.
Italian Hawk
Power Member
- Apr 21, 2009
- 594
- 132
As with everyone else, it depends. For me, I usually remove duplicate domains unless the scrape was a lower number of blogs in which case I'll usually leave them and hope they both get accepted which isn't too likely but whatever.
xxmalouinxx
Junior Member
- May 9, 2010
- 153
- 38
Personally, I always remove the duplicate domain. Except on some rare occasion where I want more than 1 domain website URL with high PR.
- Nov 8, 2009
- 8,887
- 9,192
Removing the duplicate domains does remove the duplicate urls.
shylesson
Power Member
- Jan 10, 2008
- 665
- 2,128
think he meant he uses both options in different situations like the poster above him. i like this too because the remove domains one will remove all urls from the domain and leave only have to play around with one bl on the site and not risk over-spamming a single site in WP cases making it harder to get chit to stick, but i like the remove urls one when I want the different urls, but not the dupes (obviously) without caring about them being on the same domain as in how the poster posted. =P
Scripteen
Elite Member
- Sep 19, 2009
- 1,818
- 1,930
That's it.
dungxvn
Junior Member
- Nov 11, 2009
- 182
- 50
You will get abc.com from abc.com/abcd.{html|php|htm|asp|etc}
- Nov 8, 2009
- 8,887
- 9,192
Thanks, and do you find this useful or what?
dungxvn
Junior Member
- Nov 11, 2009
- 182
- 50
It's really useful to spam. For example, you find abc.com/abc.html is not moderated ( you found the link right after posting). You will want to get more post from this blog as you know they are not moderated too. You will find this is very useful when you have huge urls list or providing services
