1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

What technique Scrapebox is using?

Discussion in 'General Programming Chat' started by free, Jul 17, 2010.

  1. free

    free Junior Member

    Joined:
    Aug 25, 2007
    Messages:
    125
    Likes Received:
    78
    I'm curious what is the technique that SweetFunny using in her Scrapebox since it perform a very large amount of queries on Google and it VERY fast!

    I know SB do multi-threading thing but IMO using 'HttpWebRequest' and phrasing data should not enough.

    if you have any clue, pls give me some hint :D
     
  2. SebastianJu

    SebastianJu Power Member

    Joined:
    Mar 27, 2008
    Messages:
    679
    Likes Received:
    130
    Why dont you ask Sweetfunny via supportmail? Or do you need info for cracking the software?

    Anyway... I dont know what you refer to with technique. Why shouldnt it be possible to have a large amount of connections? Or what do you mean?
     
  3. free

    free Junior Member

    Joined:
    Aug 25, 2007
    Messages:
    125
    Likes Received:
    78
    Well, I'm new to term of programming and I mentioned to scrapebox because I bought it and got some inspiration when I use it.
    Of course scrapebox is the best in its tasks IMO so I just want some hints to starting to coding my own custom bot!

    pls not so negative dude.
     
  4. softtouch2009

    softtouch2009 Senior Member

    Joined:
    Dec 2, 2009
    Messages:
    1,001
    Likes Received:
    225
    Occupation:
    Programming
    Location:
    ssdnet.biz
    Home Page:
    The SB team will surely not reveal the methods used for harvesting or posting etc.
    It took month's and endless hours to get it just right.
     
  5. demoniox

    demoniox Registered Member

    Joined:
    Mar 5, 2007
    Messages:
    98
    Likes Received:
    83
  6. softtouch2009

    softtouch2009 Senior Member

    Joined:
    Dec 2, 2009
    Messages:
    1,001
    Likes Received:
    225
    Occupation:
    Programming
    Location:
    ssdnet.biz
    Home Page:
    If the 2 links should be related to SB, wrong. SB does not use .net or such.
     
  7. kaidoristm

    kaidoristm Power Member

    Joined:
    Feb 13, 2009
    Messages:
    561
    Likes Received:
    726
    Occupation:
    Freelancer
    Location:
    Estonia
    Home Page:
    Im sure he's using multithreading as well. Anyway speed always depends on your connection speed.
     
    • Thanks Thanks x 1
  8. ryodimas

    ryodimas Newbie

    Joined:
    Mar 17, 2010
    Messages:
    27
    Likes Received:
    4
    maybe she use something to call Sb in own server, so it helps Sb user to get faster,
     
    • Thanks Thanks x 1
  9. kaidoristm

    kaidoristm Power Member

    Joined:
    Feb 13, 2009
    Messages:
    561
    Likes Received:
    726
    Occupation:
    Freelancer
    Location:
    Estonia
    Home Page:
    Yep it's an option as well.
     
  10. demoniox

    demoniox Registered Member

    Joined:
    Mar 5, 2007
    Messages:
    98
    Likes Received:
    83
  11. crepito

    crepito Junior Member

    Joined:
    Oct 5, 2008
    Messages:
    145
    Likes Received:
    28
    Location:
    Portugal
    This is something i would like to know as well to improve my code. Downloading all those pages + regex them would probably take more time than it takes imo :x
     
    • Thanks Thanks x 1
  12. reinrein

    reinrein Regular Member

    Joined:
    Feb 8, 2008
    Messages:
    443
    Likes Received:
    343
    Home Page:
    windows sockets can do this.
     
    • Thanks Thanks x 1
  13. kaidoristm

    kaidoristm Power Member

    Joined:
    Feb 13, 2009
    Messages:
    561
    Likes Received:
    726
    Occupation:
    Freelancer
    Location:
    Estonia
    Home Page:
    Windows socket's cant do a shit if you have slow connection.
     
  14. reinrein

    reinrein Regular Member

    Joined:
    Feb 8, 2008
    Messages:
    443
    Likes Received:
    343
    Home Page:
    OP asked what scrapebox uses, Im sure its sockets. Youre wrong, sockets can do a shit if you have a slow connection, its fast cause it only loads the needed parts of the page, it wont load the images etc. And if you will be using tools like scrapebox, you obviously need a fast connection.
     
    • Thanks Thanks x 1
  15. kaidoristm

    kaidoristm Power Member

    Joined:
    Feb 13, 2009
    Messages:
    561
    Likes Received:
    726
    Occupation:
    Freelancer
    Location:
    Estonia
    Home Page:
    Actually i saw somewhere that it uses IE control and yes it uses multithreading
     
  16. goawayplease

    goawayplease Regular Member

    Joined:
    Apr 10, 2008
    Messages:
    299
    Likes Received:
    67
    There are two ways I can think of off the top of my head:

    1: Using some kind of Web Browser control and using DOM to quickly fill out and submit forms. You can definitely multi-thread this by using a control array. This would be easy, and would look like a real browser, down to executing JS... mostly because it's pretty much a real browser. This would have a heavy bandwidth footprint.

    2: Using raw sockets, which wouldn't execute images or transfer the binary of images. You could grab the source and use Regex to handle things.
     
    • Thanks Thanks x 1
  17. howdoyou

    howdoyou Regular Member

    Joined:
    Nov 17, 2008
    Messages:
    284
    Likes Received:
    57
    Occupation:
    Programming
    Location:
    Kentucky
    goawayplease is on the right path.

    using a wb control is never going to go fast period, because it will always execute script code and load images etc.

    sockets, inet, etc will pull raw source code and can be multi threaded without executing anything.
     
    • Thanks Thanks x 1
  18. fbexpert

    fbexpert BANNED BANNED

    Joined:
    Dec 29, 2012
    Messages:
    0
    Likes Received:
    11
    This is what i got when i checked using ResHack,looks like it is developed using CodeGear RAD Studio,i don't know much about software development,but if any of you know anything,see if this helps you!
     

    Attached Files:

    • Thanks Thanks x 1
  19. free

    free Junior Member

    Joined:
    Aug 25, 2007
    Messages:
    125
    Likes Received:
    78
    many of you suggest to go for socket programming
    seem it will take time to study but it's good know where to start

    thanks guys
     
  20. TheHitman

    TheHitman Newbie

    Joined:
    Aug 6, 2009
    Messages:
    17
    Likes Received:
    0
    Pretty sure it's utilizing C#