1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Is scraping data from game servers possible?

Discussion in 'General Scripting Chat' started by Tony Barns, May 27, 2013.

  1. Tony Barns

    Tony Barns Regular Member

    Joined:
    Oct 6, 2009
    Messages:
    226
    Likes Received:
    159
    Is it possible to scrape data from a game server? Like a MMORPG game for instance such as WoW, Guild Wars 2 Etc.. I see websites like http://www.wowhead.com/ just wondering how they get all that info and I would be interested on creating a similar website for another game.

    If this is possible what's involved?
     
  2. WPRipper

    WPRipper Supreme Member

    Joined:
    Mar 24, 2010
    Messages:
    1,377
    Likes Received:
    1,493
    Location:
    Proudly romanian
    The only way is to hack their servers.
     
    • Thanks Thanks x 1
  3. zenlagor

    zenlagor Regular Member

    Joined:
    Apr 4, 2013
    Messages:
    357
    Likes Received:
    184
    Occupation:
    Virtual Pimp
    Location:
    Colombia
    Home Page:
    Wowhead have a plugin users use which collects data, also they use data mining techniques on the game files for upcoming patches/betas. Probably start with searching for "wow data mining" or whichever game you are thinking about. I'm sure you can unpack those MPQ files pretty easily.
     
    • Thanks Thanks x 1
  4. Tony Barns

    Tony Barns Regular Member

    Joined:
    Oct 6, 2009
    Messages:
    226
    Likes Received:
    159

    Will check that data mining thing out and see what I can come up with. I'm new to this but if I can figure this out it will save me a ton of time.

    Thanks
     
  5. Uberfunk

    Uberfunk Newbie

    Joined:
    Mar 15, 2013
    Messages:
    25
    Likes Received:
    13
    Maybe see if you can make some kind of add on for the game and use that to capture the data you need mate

    Sent from my GT-N7000 using Tapatalk 4 Beta
     
    • Thanks Thanks x 1
  6. WayneInc

    WayneInc Senior Member

    Joined:
    Sep 20, 2012
    Messages:
    1,178
    Likes Received:
    1,099
    You can scrape the data but if its Copyscape protected then you can get the DMCA notice so check before scrapping.,
     
    • Thanks Thanks x 1
  7. Tony Barns

    Tony Barns Regular Member

    Joined:
    Oct 6, 2009
    Messages:
    226
    Likes Received:
    159
    I checked and it's not copyscape protected. :)