1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Viewing the GENERATED source of web page? Webkit.net browser control?

Discussion in 'Visual Basic .NET' started by spiritmolecule, Dec 7, 2014.

  1. spiritmolecule

    spiritmolecule Registered Member

    Joined:
    Oct 31, 2008
    Messages:
    62
    Likes Received:
    15
    Hey,

    So I'm trying to create a bot that scrapes the generated html source from a web page in my visual basic application. This is different from what I get in the webbrowsercontrol.doctumenttext.tostring function.

    From what I understand there is no discernible way to use the default web browser control to scrape the generated source. However, when searching google I may have found a potential answer here: http://stackoverflow.com/questions/...generated-html-source-using-c-sharp-or-vb-net

    So, I've downloaded the webkit.net browser control, and added the .dll to my vb.net toolbox, but whenever I try to run it in vb.net 2013, I get this error.

    [​IMG]

    When I try to run it in vb.net 2010 I get this error.

    [​IMG]

    I get these errors without writing any code. I just have to add the webkit.net browser to my form and then try to run.

    So, as it stands right now I have no idea how to approach this problem. Google searches for these errors have revealed nothing, so far. If anyone here has an idea of how I can get the generated source within vb.net, with or without webkit.net that would be hugely appreciated.

    Thanks!!!
     
  2. spiritmolecule

    spiritmolecule Registered Member

    Joined:
    Oct 31, 2008
    Messages:
    62
    Likes Received:
    15
    Alright, it turns out that I managed to solve this shortly after posting this thread. For anyone else who may stumble upon this thread wondering the same thing, watch this video and follow the instructions.

    https://www.youtube.com/watch?v=ZpNzQq8zmuk

    Works great now!
     
  3. spiritmolecule

    spiritmolecule Registered Member

    Joined:
    Oct 31, 2008
    Messages:
    62
    Likes Received:
    15
    Just an update for anyone who may stumble upon this thread in the future. I found a better way to access the generated source, and you can do it with the normal browser control. No need to fuck with webkit.net

    Everything you need to know is explained at this link: http://ericappel.net/blog/viewhtmlsourcegeneratedbyajax.aspx

    Here's a quote of the essential part:

    Good luck!