1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Hrefer Limit Bypass?

Discussion in 'Black Hat SEO Tools' started by lewi, Oct 22, 2010.

  1. lewi

    lewi Jr. VIP Jr. VIP Premium Member

    Joined:
    Aug 5, 2008
    Messages:
    2,309
    Likes Received:
    818
    Hey,

    Am just in the middle of a scrape and the number of links is building up fast!

    BUT! The problem i use to have in scrapebox was that a .txt file can only hold 1million results (i know alot but still not enough) but there is a workaround for that!

    However in hrefer what it seems to do is save to the file name you put in the bottom! That's great but that means if im not watching hrefer closely and constantly then i wont know when it is near it's 1million limit and so will loose a load of scraped links until i enter in a new file name right?

    Is there any way to automatically do this or make hrefer create a new file when it has reached 1million links?

    Thanks
    Lewi
     
  2. scubasteve

    scubasteve Junior Member

    Joined:
    May 10, 2007
    Messages:
    164
    Likes Received:
    77
    Why not just use a list management program to split the file up into 1 million links for you, after hrefer is done harvesting?