1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

SB keeps hanging when harvesting proxies

Discussion in 'Black Hat SEO Tools' started by Ranko Jones, Aug 24, 2011.

  1. Ranko Jones

    Ranko Jones BANNED BANNED

    Joined:
    Mar 3, 2011
    Messages:
    1,677
    Likes Received:
    146
    When I would put custom proxy lists in I just scraped it used to take a while like it was frozen sure but now when I hit abort to get the proxies it just seems to hang.

    Anyone else had this/know a solution?

    Seems ok when I only put a few in but when I put a decent amount in to get a decent list it seems to hang.
     
    Last edited: Aug 24, 2011
  2. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    Only put in 2k sources at a time. Then before pressing start scroll down to the bottom, so that when the proxy numbers appear at those urls you know it is done. Do this in case it doesn't think it's finished when it obviously is. So then you can press stop if needed, and it won't freeze up. Press OK and you're done.

    Putting in 20k sources at a time = asking for freeze.
     
  3. Ranko Jones

    Ranko Jones BANNED BANNED

    Joined:
    Mar 3, 2011
    Messages:
    1,677
    Likes Received:
    146
    I only had 563 (I tried 100 and it froze the same way) sources. And it freezes any time I press abort above 100.

    I'm thinking maybe it's a bad source causing it to crash now.
     
    Last edited: Aug 24, 2011
  4. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    It "freezes" any time you're adding them. That's why I said to scroll down to the bottom of the list just before you press start. That way when the number of proxies next to the source appears at the very bottom result, you know that it's done, despite the "freezing". It's at that point that you can press "abort" and it will not freeze on you (actual freeze). If you press abort *before* the last source has been process it WILL freeze properly.

    Extracting proxies from 2k proxies sources can take up to 30 mins for me.
     
  5. Ranko Jones

    Ranko Jones BANNED BANNED

    Joined:
    Mar 3, 2011
    Messages:
    1,677
    Likes Received:
    146
    Yes I know 30 mins is normal but it's been going for 1-2 hours now! and I put it to the bottom, it got to a few before the bottom saying 'searching' but hasn't budged for over an hour. Hence HARD freeze imo.

    Edit: Figured it out seems a cpl of the sources it must have been drawing TONS of proxies cos i got a list of 120k after only checking for 45 seconds :D
     
    Last edited: Aug 24, 2011
  6. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    Yes, some sources can be a bitch like that. It's bittersweet, they have so many proxies but 100k proxies per page = asking for a freeze.

    Tip: depending on your CPU at home, the xsserver CPUs are fast as you can get really, they generally check a lot faster than home computers. Though a lot of the time you're gonna be harvesting / posting with your VPS so you might be forced to do it at home.