1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Did Scrapebox URL harvester get a lot slower all of the sudden?

Discussion in 'Black Hat SEO Tools' started by deviatus, Aug 20, 2010.

  1. deviatus

    deviatus Power Member

    Joined:
    May 25, 2007
    Messages:
    517
    Likes Received:
    387
    I used to scrape at a speed of 1000 urls per second, it was awesome. Now it's down to 150 per second no matter which proxy system I use, and it's collecting a smaller number of urls per keyword also.

    Blog commenting has remained the same good speed.
     
  2. Thrashingshrimp

    Thrashingshrimp Junior Member

    Joined:
    Mar 31, 2009
    Messages:
    172
    Likes Received:
    40
    Honestly, do you really need 1000 urls per second?

    But anyway, are all your threads, timeout, proxy settings the same?
     
  3. Satyren

    Satyren Regular Member

    Joined:
    Nov 29, 2009
    Messages:
    496
    Likes Received:
    598
    Location:
    EU
    I've experienced this also.
     
  4. deviatus

    deviatus Power Member

    Joined:
    May 25, 2007
    Messages:
    517
    Likes Received:
    387
    Saves time, and time adds up. :D

    All different configurations tried, and I'll get roughly the same speed with G, Y, and B. I really can't pin it on any other variable except something with the harvester itself.
     
  5. studentcashnow

    studentcashnow Regular Member

    Joined:
    Aug 21, 2009
    Messages:
    246
    Likes Received:
    186
    mine is doing it too . :S
     
  6. Thrashingshrimp

    Thrashingshrimp Junior Member

    Joined:
    Mar 31, 2009
    Messages:
    172
    Likes Received:
    40
    Hmm, maybe the search engines did some sort of update that's throwing off Scrapebox?

    Or a Scrapebox update itself could have done this...

    Eh, who knows?
     
  7. urbancyborg

    urbancyborg Newbie

    Joined:
    Apr 6, 2010
    Messages:
    30
    Likes Received:
    2
    aww I just bought it so I hope It will still be a good tool
     
  8. paincake

    paincake Power Member

    Joined:
    Aug 18, 2010
    Messages:
    716
    Likes Received:
    3,099
    Home Page:
    Yeah, it got a lot slower for me too.
     
  9. TheMatrix

    TheMatrix BANNED BANNED

    Joined:
    Dec 20, 2008
    Messages:
    3,444
    Likes Received:
    7,279
    Ironically, mine has improved. Earlier, I had a 512k connection, and did an occasional 8 URLs/s.

    Now, with a 2mbit connection, I get ~50 per sec.

    My connections are set to 40 for each SE, for more than that, SB throttles.

    Maybe, you should try by scraping each SE individually.

    TheMatrix
     
  10. Satyren

    Satyren Regular Member

    Joined:
    Nov 29, 2009
    Messages:
    496
    Likes Received:
    598
    Location:
    EU
    40?!

    I have 100mbit connection and 15 connections gives me the best results.
     
  11. TheMatrix

    TheMatrix BANNED BANNED

    Joined:
    Dec 20, 2008
    Messages:
    3,444
    Likes Received:
    7,279
    Well, I actually meant that I'm on a 1 gbps line shared amongst several users.

    [​IMG]

    So, sometimes when I'm lucky, I get even upto 70 per sec.

    TheMatrix
     

    Attached Files:

  12. paincake

    paincake Power Member

    Joined:
    Aug 18, 2010
    Messages:
    716
    Likes Received:
    3,099
    Home Page:
    what country do you live in and how much does a 1gbps line cost?
     
  13. TheMatrix

    TheMatrix BANNED BANNED

    Joined:
    Dec 20, 2008
    Messages:
    3,444
    Likes Received:
    7,279
    I'm in India. And it cost me ~$300 per month. And the bandwidth is unlimited.