Recent content by huyvun

Hey - What is the etiquette for BHW irc , it seems awfully silent.. Any suggestions on how/where I can begin a chat with other users and discuss an idea I have .. ?

Hopefully this idea will resolve the issue of 'how can i get some bitcoins' both parties need adsense accounts type in , ashod then the TLD ME, and then a line that goes from right to left , top to bottom with the word GooBits after it

Hi, I just wrote a gumtree phone scraper for a friend, and it works suprisingly well - (alberit a bit slow) Is there any demand for a scraper such as this ?

want opinions, on what site is considered the hardest to crack.. for example,, if the question was - what is the hardest windows app to reverse engineer, without a doubt it would be skype .. ( the most hardcore anti-debugging techniques ever implemented into an app ). so want to know, what you...

agreed... that's what i was thinking too sites which pull content in via async js.. or going a step further.. js which downloads obfsucated js which re-assembles ( like self modifying code ), at load time, which in turn pulls content .. this would be almost impossible to scrape, unless you...

the number of proxies is irrelevant to the question. - you're suggesting that the only defense a site has against scraping is IP detection... anyways.....

well, fb for example have measures to analyze frequency of requests, (intervals too), path of links crawled etc,, and very quickly they detect bot or human, unless scrape software is very complex (i'm talking when you start scraping thousands of links,, then fb shuts you down) linkedin looks...

Any thoughts on what sites are considered far to difficult to scrape..? Could be because the site has very good security/anti scraping technology ? Mix of html/Js, too obfuscated ? Security such as rotating cookies,, detection of browser/curl header orders etc..

I've made a small tool that can detect if you are logged into fb, who you are etc, without using the facebook sdk... I'm going to extend this remotely, so that it might be possible to , automatically determine who a visitor is to your site, with minimal info ,, e.g their name, country and gender...

one of the components of the scraper was an invisible pkt sniffer which worked well until I encountered a lot of Ring0 issues with win7+ ( esp win64) . In any case I found a better alternative, however at present only works on Win/FF ( but on all versions of windows )... Is FF the most common...

it does - it compiles the data into a table, - with preset field names. in a fixed format - so it's actually very well designed for doing calc on the data

C and assembler

i've created a small screencast of my initial runs ( but i cant post links here), so please look at the about me in my profile, as i have put the youtube link here ... btw- the screencast recorder is extremely slow ( looks like 5x slower than it was running at ) the tube watch id is v=83BtDoOLmKY

what is the pre-reqs to post links here ?

FYI: If anyone starts testing out the platform, please msg me on skype.. At present you need to be running windows ( any flavor, except vista ).