Is scraping data from game servers possible?

Tony Barns · May 27, 2013

Is it possible to scrape data from a game server? Like a MMORPG game for instance such as WoW, Guild Wars 2 Etc.. I see websites like http://www.wowhead.com/ just wondering how they get all that info and I would be interested on creating a similar website for another game.

If this is possible what's involved?

WPRipper · May 27, 2013

The only way is to hack their servers.

zenlagor · May 27, 2013

Tony Barns said:
Is it possible to scrape data from a game server? Like a MMORPG game for instance such as WoW, Guild Wars 2 Etc.. I see websites like http://www.wowhead.com/ just wondering how they get all that info and I would be interested on creating a similar website for another game.

If this is possible what's involved?

Wowhead have a plugin users use which collects data, also they use data mining techniques on the game files for upcoming patches/betas. Probably start with searching for "wow data mining" or whichever game you are thinking about. I'm sure you can unpack those MPQ files pretty easily.

Tony Barns · May 27, 2013

zenlagor said:
Wowhead have a plugin users use which collects data, also they use data mining techniques on the game files for upcoming patches/betas. Probably start with searching for "wow data mining" or whichever game you are thinking about. I'm sure you can unpack those MPQ files pretty easily.

Will check that data mining thing out and see what I can come up with. I'm new to this but if I can figure this out it will save me a ton of time.

Thanks

Uberfunk · May 27, 2013

Maybe see if you can make some kind of add on for the game and use that to capture the data you need mate

Sent from my GT-N7000 using Tapatalk 4 Beta

WayneInc · May 27, 2013

You can scrape the data but if its Copyscape protected then you can get the DMCA notice so check before scrapping.,

Tony Barns · May 28, 2013

WayneInc said:
You can scrape the data but if its Copyscape protected then you can get the DMCA notice so check before scrapping.,

I checked and it's not copyscape protected.

Is scraping data from game servers possible?

Tony Barns

Regular Member

WPRipper

Elite Member

zenlagor

Regular Member

Tony Barns

Regular Member

Uberfunk

Newbie

WayneInc

BANNED

Tony Barns

Regular Member

Main Menu

Marketplace

Making Money

BlackHat World