1. This website uses cookies to improve service and provide a tailored user experience. By using this site, you agree to this use. See our Cookie Policy.
    Dismiss Notice

ScrapeBox the ULTIMATE SERP Scraper & Auto Blog Commenter with PRStorm Mode

Discussion in 'SEO - Link building' started by Sweetfunny, Oct 15, 2009.

  1. Sweetfunny

    Sweetfunny Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 13, 2008
    Messages:
    1,923
    Likes Received:
    5,198
    Location:
    ScrapeBox v2.0
    Home Page:
    Thanks, we really appreciate it! If you want to help, rather than donate you could purchase a premium plugin or another SB license and it will help you plus help us keep SB running for the next 7 years. :)

    Are you using a VPS? Your machine might be out of RAM, please send an email to support with further details so we can see what's wrong.
     
  2. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    5,192
    Likes Received:
    2,824
    Gender:
    Male
    Home Page:
    New Video on the Metrics Plugin

     
  3. Mr.Boss

    Mr.Boss Regular Member

    Joined:
    Sep 5, 2012
    Messages:
    478
    Likes Received:
    143
    Gender:
    Male
    Occupation:
    Founder
    Location:
    Colombo, Sri Lanka
    Home Page:
    I am trying to run Scrapbox Competition Finder with more than 1 thread and I have more than enough private proxies but no matter what number of connections I set it always runs in 1 thread. Can you please let me know how to increase the the number of threads.
    [​IMG]
     
  4. Nargil

    Nargil Jr. VIP Jr. VIP

    Joined:
    May 10, 2012
    Messages:
    7,054
    Likes Received:
    4,689
    Location:
    Europe
    Home Page:
    I am sure that this request has already been mentioned here, but could we get a progress bar?

    I mean, when I am removing all the URLs from a file with 2.5 million URLs that are contained in the file with 5 million URLs, then yeh, it's going to take 48 hours plus, but I would really love to know at least the approximate ETA or at the very least the current progress. Thanks :)
     
  5. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    5,192
    Likes Received:
    2,824
    Gender:
    Male
    Home Page:
    When you set a delay it will override connections and set it to 1. Point being that if you need a delay then you shouldn't be using more then 1 connection because you can simply lower the connections and then effectively accomplish the same thing. So just lower your connections and remove the delay. This is pretty much true of anything in scrapebox.



    Does it really take you that long? I can do it exponentially quicker.

    For example if you split that 2.5 million file into 5 files of 500K each and import and compare them it will go pretty fast and then you will be done with the lot in less then an hour probably. You could even build an automator job for this.

    But there is a scale, and when you start reachigng a threshold with comparing files, its like a bell curve, all is well to a point and then as file size increases some time increases dramatically. Its the nature of it. My numbers may not be exact, but you get the point. There is also a further gain in the fact that on the 2nd 500K file your going to be comparing against like 4.7 million urls instead of 5 million etc..

    Great post you made on expired domains yesterday too, should have thanked you there, but was in a hurry.
     
  6. Nargil

    Nargil Jr. VIP Jr. VIP

    Joined:
    May 10, 2012
    Messages:
    7,054
    Likes Received:
    4,689
    Location:
    Europe
    Home Page:
    Well it's been more like 56 now. :D And thank you, glad you like it! :)

    Well I did some comparing of, give or take, 100K domains against 4 million file and can't say that it was super fast. Took an hour or two, but I suppose that the other bigger master file is the bottleneck here. I fully understand what you are saying and I have a similar experience, but it never really did go that fast on my end. Thank you for the explanation :)
     
  7. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    5,192
    Likes Received:
    2,824
    Gender:
    Male
    Home Page:
    Wow thats intense. It could also be the diversity. You might have a really diverse list vs the lists I was comparing with were a lot the same so the deduplication went much faster.

    One other thing you can try which might help is if you are comparing on a domain level and not on the specific url, on the list that is the "old" list that your comparing against - you could remove duplicate domains (if you haven't already) and then trim them to root. That way you are ditching 50% or more of the total characters that have to be dealt with, which generally helps, but may or may not do that great depending on your list.

    Its good to know though, in truth I don't "regularly/constantly" compare lists that are that big, I try to avoid it when possible as it does take a while regardless.

    Im sitting here trying to think of a better way to do it and I have 1 idea, but mostly drawing a blank. Ill let you know if I come up with something.
     
  8. Nargil

    Nargil Jr. VIP Jr. VIP

    Joined:
    May 10, 2012
    Messages:
    7,054
    Likes Received:
    4,689
    Location:
    Europe
    Home Page:
    Well I had to take the notebook today for 2 hour drive and filtering still wasn't finished so I somehow managed to make the battery last long enough to reach my destination. So yeh, it's still filtering. :)

    Well actually, I am sure that at least half of the new list is contained within the old one I am comparing against. Of course, all the domains were deduped and trimmed to root. Not sure if I can go any faster at this point. I really just wanted some kind of a progress bar so I can estimate when it will finish give or take. I remember importing 3 million domains to availability checker tool within SB and import alone took 72 hours. :D

    Let me know, sure, anything will help. :)
     
  9. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    5,192
    Likes Received:
    2,824
    Gender:
    Male
    Home Page:
    Well I don't work for scrapebox but Ill pass it on to them, and they read the thread anyway.

    I have one more idea though, have you tried:

    http://pc-fitness.tripod.com/images/hammer computer.jpg
     
  10. Nargil

    Nargil Jr. VIP Jr. VIP

    Joined:
    May 10, 2012
    Messages:
    7,054
    Likes Received:
    4,689
    Location:
    Europe
    Home Page:
  11. softtouch2009

    softtouch2009 Senior Member

    Joined:
    Dec 2, 2009
    Messages:
    1,055
    Likes Received:
    246
    Occupation:
    Programming
    Location:
    ssdnet.biz
    Home Page:
    Can you provide both files (zipped) so I can check if there is a way to optimize the code for such scenario?
     
  12. Sheen91

    Sheen91 Regular Member

    Joined:
    Dec 2, 2008
    Messages:
    216
    Likes Received:
    110
    Location:
    Australia
    Hi Sweet,

    I bought scrapebox quite some time ago but since have slowed down on IM and use a mac. Recently bought a PC as well and was looking to collate useful software for IM. I was wondering what proof you need etc. Would you be able to PM/start conversation with me. Thanks
     
  13. Nargil

    Nargil Jr. VIP Jr. VIP

    Joined:
    May 10, 2012
    Messages:
    7,054
    Likes Received:
    4,689
    Location:
    Europe
    Home Page:
    On the way :)

    Btw, it's already done! Yay! 4 days or so :D
     
  14. ganesha7

    ganesha7 Regular Member

    Joined:
    Dec 8, 2012
    Messages:
    350
    Likes Received:
    61
    Gender:
    Male
    Occupation:
    Ur friendly marketing expert!
    Location:
    Blackhatworld :)
    hi, bought SB now.. transaction id starts with 0KF1... waiting for activation. thanks..
     
  15. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    5,192
    Likes Received:
    2,824
    Gender:
    Male
    Home Page:
    They don't pm. You need to contact them
    http://www.scrapebox.com/contact-us
     
    • Thanks Thanks x 1
  16. ganesha7

    ganesha7 Regular Member

    Joined:
    Dec 8, 2012
    Messages:
    350
    Likes Received:
    61
    Gender:
    Male
    Occupation:
    Ur friendly marketing expert!
    Location:
    Blackhatworld :)
  17. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    5,192
    Likes Received:
    2,824
    Gender:
    Male
    Home Page:
    I replied. Check you pm.
     
  18. roki4ka

    roki4ka Senior Member

    Joined:
    Jun 20, 2016
    Messages:
    935
    Likes Received:
    706
    Must have for any serious IMer...

    Thank you guys for this software
     
    • Thanks Thanks x 1
  19. Sheen91

    Sheen91 Regular Member

    Joined:
    Dec 2, 2008
    Messages:
    216
    Likes Received:
    110
    Location:
    Australia
  20. online28

    online28 Senior Member

    Joined:
    Feb 24, 2011
    Messages:
    1,174
    Likes Received:
    136
    Scrapebox Page Authority Addon always show error result after I check few hundred URLS.
    How to solve this problem?

    Thanks!