scrapebox scrape limit

xhpdx

Regular Member

Sep 21, 2008

326

2,172

• Jan 7, 2011

• #1

I haven't scraped for a while and today I noticed I've passed the 1 million limit scraped urls. Has anyone reached the new limit?

 

M1ndfluX

Banned - Selling via PM

Dec 23, 2009

1,129

882

• Jan 7, 2011

• #2

Yeah same here. It sucks...

I just brake down my lists and go from there but if someone has a solution i would be glad to hear this...

 

SMMSEO

Regular Member

Oct 14, 2009

250

47

• Jan 8, 2011

• #3

Yep it sucks

 

Y

YouFoundIt

Registered Member

Mar 31, 2011

74

4

• Apr 3, 2011

• #4

Whenever you scrape past 1million, scrapebox always puts the excess urls in a harvester folder such as batch001 and batch002, you can always add the excess urls after removing duplicates from your batch001, then by adding your batch002 you will gain all the urls that were over the 1million harvested.

 

Last edited: Apr 3, 2011

evilartemis

Junior Member

May 30, 2009

162

16

• Apr 5, 2011

• #5

Are the urls in batch00x the excess urls after 1,000,000th url, or does it include the first 1,000,000 urls?