1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

XSserver and link checker problems

Discussion in 'Black Hat SEO' started by Cleaner, Sep 27, 2011.

  1. Cleaner

    Cleaner Newbie

    Joined:
    Apr 19, 2011
    Messages:
    20
    Likes Received:
    2
    I'm experiencing freezes when I run the built-in Scrapebox link checker. But I don't have this problem or anything when I use the stand alone Scrapebox link checker that can be downloaded from their site.

    Is there anybody else experiencing this? I have no problems with posting. It's only the link checker that seems to give me hangs and freezes

    My setup:

    - 2Gb ram VPS
    - 50 semi dedi proxies: below 900 ms (also tried 20 dedi proxies)
    - Connections: 5
    - Timeout: 90 sec
     
  2. kvmcable

    kvmcable Supreme Member

    Joined:
    Dec 28, 2010
    Messages:
    1,355
    Likes Received:
    2,815
    Occupation:
    24 year business owner - old school dude
    Location:
    KFC - BW3
    Why are you burning bandwidth with link checker? Turn proxies off when running link checker because you're not posting anything and just reading pages to see if your link exists.

    Second suggestion is to run your successful post list through the malware checker add-on. You might be hitting infected sites and stopping progress.

    2 things I'd checked first.
     
    • Thanks Thanks x 1
  3. server255

    server255 Junior Member

    Joined:
    Dec 30, 2009
    Messages:
    157
    Likes Received:
    92
    Location:
    In a data center
    I'm also at XS. When link checking CPU usage goes to 100% occasionally and it freezes for few seconds... But i have seen that also with another VPS provider.

    60 connections, no proxies.
     
    • Thanks Thanks x 1
  4. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    1. use the SEPARATE link checker program, not the addon in SB
    2. close all other programs
    3. run your list through the malware addon, run the errors through twice again to maximize good URLs (in case of dead proxies)
    4. do NOT use proxies with the link checker
    5. split your lists into lists of no more than 50k each
    6. if your list still crashes, split your list in half and run in parts
    7. for any part that crashes, split it and keep splitting it until it's so small you can afford to just not run the rest
    8. no more than 50 connections
     
    • Thanks Thanks x 1
    Last edited: Sep 27, 2011
  5. Cleaner

    Cleaner Newbie

    Joined:
    Apr 19, 2011
    Messages:
    20
    Likes Received:
    2
    Thanks for these great suggestions. Didn't know that I could better check links without proxies. And good one about the malware checker.

    Thanks for sharing these tips.