lewi
Elite Member
- Aug 5, 2008
- 2,404
- 893
Hey,
Am just in the middle of a scrape and the number of links is building up fast!
BUT! The problem i use to have in scrapebox was that a .txt file can only hold 1million results (i know alot but still not enough) but there is a workaround for that!
However in hrefer what it seems to do is save to the file name you put in the bottom! That's great but that means if im not watching hrefer closely and constantly then i wont know when it is near it's 1million limit and so will loose a load of scraped links until i enter in a new file name right?
Is there any way to automatically do this or make hrefer create a new file when it has reached 1million links?
Thanks
Lewi
Am just in the middle of a scrape and the number of links is building up fast!
BUT! The problem i use to have in scrapebox was that a .txt file can only hold 1million results (i know alot but still not enough) but there is a workaround for that!
However in hrefer what it seems to do is save to the file name you put in the bottom! That's great but that means if im not watching hrefer closely and constantly then i wont know when it is near it's 1million limit and so will loose a load of scraped links until i enter in a new file name right?
Is there any way to automatically do this or make hrefer create a new file when it has reached 1million links?
Thanks
Lewi