1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

ScrapeBox : Avg Urls/Sec - Harvesting

Discussion in 'Black Hat SEO' started by protoss33, Dec 1, 2012.

  1. protoss33

    protoss33 Newbie

    Joined:
    Oct 17, 2009
    Messages:
    17
    Likes Received:
    1
    Hi guys,

    I would like to know how many Urls per second you scrape with scrapebox?

    What is the best way to have the more biggest number of urls per second?

    For the moment, i use VPS with many public proxies and i have 180 urls/sec.
     
    Last edited: Dec 1, 2012
  2. alaltaierii

    alaltaierii Supreme Member

    Joined:
    Jun 11, 2010
    Messages:
    1,408
    Likes Received:
    349
    I'm getting about 30 urls/sec. Harvesting with 60 private proxies and 6 connections. I can scrape days with this settings without the proxies to be blacklisted.
     
  3. protoss33

    protoss33 Newbie

    Joined:
    Oct 17, 2009
    Messages:
    17
    Likes Received:
    1
    Thanks you for your answer, anybody else?
     
  4. moonlighsunligh

    moonlighsunligh Jr. VIP Jr. VIP Premium Member

    Joined:
    May 1, 2010
    Messages:
    1,623
    Likes Received:
    218
    With 10 proxies if I recall correctly around 100/sec. 4 threads.
     
  5. myfault

    myfault Power Member

    Joined:
    Sep 21, 2012
    Messages:
    636
    Likes Received:
    121
    Very old thread but i am getting only 20 avg/urls in 20 private proxies with 4 connection. Is there anyway to speed up ?
     
  6. Rua999

    Rua999 Power Member

    Joined:
    Jun 25, 2011
    Messages:
    630
    Likes Received:
    407
    I am having the same problem, for me the problem is the speed my ISP currently provides me.. only 7mb/s. You can check your internet speed at http://www.speedtest.net.

    If it's low like mine you would be better off getting a cheap vps and putting sb on it o check with your ISP to see if thy can speed up your connection.

    Where i am, they are rolling out a new faster broadband speed within the next few weeks (up to 70 mb/s) so im waiting for that.
     
  7. ron1703

    ron1703 Junior Member

    Joined:
    May 19, 2013
    Messages:
    132
    Likes Received:
    15
    I am doing 1000 per second on a specific niche with 40 shared proxies :)
     
  8. ElSchavone

    ElSchavone Newbie

    Joined:
    Dec 29, 2015
    Messages:
    35
    Likes Received:
    5
    1000 per second with 5 proxies, scraping only on Bing ( google doesnt work but anyhow ) with 50 threads, 35% CPU, 121MB memory usage...