1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Faster url/list scraping? PLS HELP

Discussion in 'Black Hat SEO Tools' started by fullwall3t, Sep 12, 2015.

  1. fullwall3t

    fullwall3t Power Member

    Joined:
    Apr 22, 2015
    Messages:
    767
    Likes Received:
    84
    Hello,
    is there any way to set more efectivly GSA SER to scrape URL, because i have scrapebox and that is million times faster, but problem is that it freezes in the middle of the process and if i add to many KWS and want to stop harvesting and add new proxies after i hit stop/pause harvesting it freezes again.. So is there any way how to set GSA SER to use more threads to scraping urls?
     
  2. mindmaster

    mindmaster Jr. VIP Jr. VIP

    Joined:
    Sep 16, 2010
    Messages:
    2,876
    Likes Received:
    1,306
    Home Page:
    I understand your scrapebox is freezing?
    What are your pc/vps specs? Are you using the latest version of scrapebox?
     
  3. zyx2000

    zyx2000 Registered Member

    Joined:
    May 6, 2011
    Messages:
    57
    Likes Received:
    7
    Could it be low memory?
     
  4. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,875
    Likes Received:
    2,058
    Gender:
    Male
    Home Page:
    If you don't have enough resources Scrapebox can freeze. I can't help you get GSA faster, but your Scrapebox problem is probably solveable.

    If you get 64bit, assuming you have a 64bit OS, then it can use as much resources as you have, so that could help. If you don't have enough resources then you will have to just work with smaller lists.

    You could make small automator runs to do scraping and then when its done just swap the keywords in all the files and repeat.

    Also you don't need to pause to add more proxies, you can use the auto load proxy from file option in the harvester and Scrapebox will automatically reload proxies from file when it needs it. Or if you are using the detailed harvester you can set it to reload every X minutes.

    so using options like these should solve the freezing issue, but its likely due to lack of system resources anyway.
     
  5. fullwall3t

    fullwall3t Power Member

    Joined:
    Apr 22, 2015
    Messages:
    767
    Likes Received:
    84
    Thanks for trying to help, my mistake i ahould wrote down specs if my vps.. Hw is not an issue, 8gb ddr3 1800mhz, quad core 3.5ghz, internet is about 20mb/s. i tried to lower number of threads in scrapebox.. it doesnt help, still same issue, with maximum threads i don't exceed usuall more than 50% of hw usage

     
  6. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,875
    Likes Received:
    2,058
    Gender:
    Male
    Home Page:
    does it popup a error window? If so there is a bug report file called bugreport.txt, its in your main Scrapebox folder >> configuration folder.

    Send that to scrapeboxhelp (at] gmail {dot) com

    If there is no error box, can you post a screenshot or a link to one?