Argh! Scrapebox

Discussion in 'BlackHat Lounge' started by dr.pepper, Feb 24, 2012.

  1. dr.pepper

    dr.pepper Regular Member

    Joined:
    Feb 13, 2012
    Messages:
    275
    Likes Received:
    98
    Been running a havester for 24 hours and clicked abort. Then crashed :(
    Time to start again!

    Any ideas why it did this?
     
  2. GoldenGlovez

    GoldenGlovez Moderator Staff Member Moderator Jr. VIP

    Joined:
    Mar 23, 2011
    Messages:
    910
    Likes Received:
    2,045
    Occupation:
    Implementing Crazy Ideas
    Location:
    Taiwan
    Home Page:
    I've never experienced a crash when aborting a harvesting session. However, you can find the URL's you've harvested before the crash by going to the 'Harvester_Sessions' folder in your Scrapebox folder.
     
    • Thanks Thanks x 1
  3. Kickflip

    Kickflip BANNED BANNED

    Joined:
    Jan 29, 2010
    Messages:
    2,038
    Likes Received:
    2,466
    It can crash if you have too many URLs harvested. I have this happen quite often when I have over a million URLs. But then I just go in the Harvested URL folder and retrieve them in there. Are you scraping from multiple search engines, or just google? I find it happens mostly when I scrape from Yahoo and Google at the same time.
     
  4. dr.pepper

    dr.pepper Regular Member

    Joined:
    Feb 13, 2012
    Messages:
    275
    Likes Received:
    98
    Your a genius!
    Was looking for the backup but i thought it was only for the Posting!

    Cheers mate, appreciate it
     
  5. dr.pepper

    dr.pepper Regular Member

    Joined:
    Feb 13, 2012
    Messages:
    275
    Likes Received:
    98
    Yes mate, from Google, AOL and Yahoo - and yes before it crashed id estimate at over a million urls