1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Argh! Scrapebox

Discussion in 'BlackHat Lounge' started by dr.pepper, Feb 24, 2012.

  1. dr.pepper

    dr.pepper Regular Member

    Joined:
    Feb 13, 2012
    Messages:
    275
    Likes Received:
    97
    Been running a havester for 24 hours and clicked abort. Then crashed :(
    Time to start again!

    Any ideas why it did this?
     
  2. GoldenGlovez

    GoldenGlovez Moderator Staff Member Moderator Jr. VIP

    Joined:
    Mar 23, 2011
    Messages:
    701
    Likes Received:
    1,713
    Location:
    Guangdong, China
    Home Page:
    I've never experienced a crash when aborting a harvesting session. However, you can find the URL's you've harvested before the crash by going to the 'Harvester_Sessions' folder in your Scrapebox folder.
     
    • Thanks Thanks x 1
  3. Kickflip

    Kickflip BANNED BANNED

    Joined:
    Jan 29, 2010
    Messages:
    2,038
    Likes Received:
    2,465
    It can crash if you have too many URLs harvested. I have this happen quite often when I have over a million URLs. But then I just go in the Harvested URL folder and retrieve them in there. Are you scraping from multiple search engines, or just google? I find it happens mostly when I scrape from Yahoo and Google at the same time.
     
  4. dr.pepper

    dr.pepper Regular Member

    Joined:
    Feb 13, 2012
    Messages:
    275
    Likes Received:
    97
    Your a genius!
    Was looking for the backup but i thought it was only for the Posting!

    Cheers mate, appreciate it
     
  5. dr.pepper

    dr.pepper Regular Member

    Joined:
    Feb 13, 2012
    Messages:
    275
    Likes Received:
    97
    Yes mate, from Google, AOL and Yahoo - and yes before it crashed id estimate at over a million urls