1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

C# Headless Browser, Multithreads

Discussion in 'C, C++, C#' started by novalagoon, Nov 9, 2013.

  1. novalagoon

    novalagoon Newbie

    Joined:
    Jan 20, 2013
    Messages:
    17
    Likes Received:
    2
    I have read the posts here in the forum but couldn't find an answer.

    I want to write a multithreaded bot, which can process sites with a lot of ajax. What's the best liabrary, webbrowser control, to use with c# achieve this?

    Thanks
     
  2. KirtiD

    KirtiD Newbie

    Joined:
    Jun 13, 2013
    Messages:
    49
    Likes Received:
    15
    Location:
    Beed
    You can use xulrunner & Geccofx it support java script,ajax etc also well documentedYou can find lots of help on its web site, let me know if you need any help
     
    • Thanks Thanks x 1
  3. KirtiD

    KirtiD Newbie

    Joined:
    Jun 13, 2013
    Messages:
    49
    Likes Received:
    15
    Location:
    Beed
    You can use xulrunner & Geccofx it support java script,ajax etc also well documentedYou can find lots of help on its web site, let me know if you need any helpYou can use Awesomium which support headless as well as browser baseI am not very sure about full ajax ,java script support in headless browser
     
    • Thanks Thanks x 1
  4. novalagoon

    novalagoon Newbie

    Joined:
    Jan 20, 2013
    Messages:
    17
    Likes Received:
    2
    Thanks for your answer, can you please point me a little bit more in the right direction?

    I downloaded GeckoFX-22.0 and XulRunner 22.0, copied XulRunner to the GeckoFX folder and compiled the solution. Now I have the DLLs but don't know where to get started now? ;)

    (Awesomium can handle JavaScript and Ajax, at least for what I needed, but it's not thread-safe)

    Regards,
    nova
     
  5. rootjazz

    rootjazz Jr. VIP Jr. VIP

    Joined:
    Dec 21, 2012
    Messages:
    614
    Likes Received:
    313
    Occupation:
    Developer
    Location:
    UK
    Home Page:
    IIRC you can get awesomnium to work multi threaded, takes a bit of coding around, but it is possible. Or it was. But it was quite buggy as a headless browser to really use when I last checked.
     
  6. rootjazz

    rootjazz Jr. VIP Jr. VIP

    Joined:
    Dec 21, 2012
    Messages:
    614
    Likes Received:
    313
    Occupation:
    Developer
    Location:
    UK
    Home Page:
    IIRC you can get awesomnium to work multi threaded, takes a bit of coding around, but it is possible. Or it was. But it was quite buggy as a headless browser to really use when I last checked.
     
    • Thanks Thanks x 1
  7. novalagoon

    novalagoon Newbie

    Joined:
    Jan 20, 2013
    Messages:
    17
    Likes Received:
    2
    Thanks for your answer, rootjazz, I think I will give GeckoFX a try. I got it working and can browse sites, etc.

    But I have some issues with ajax (e.g.: if a control loads additional data, for example if you type something into google search, the autosuggest does not load).

    Another question that arose is, how to go headless, do I use the forms control and just don't display it?

    I can't find a decent documentation for GeckoFX, does anyone know some useful ressources?

    Nova
     
  8. rootjazz

    rootjazz Jr. VIP Jr. VIP

    Joined:
    Dec 21, 2012
    Messages:
    614
    Likes Received:
    313
    Occupation:
    Developer
    Location:
    UK
    Home Page:
    Try selenium with phantom JS (ghostdriver).
     
  9. KirtiD

    KirtiD Newbie

    Joined:
    Jun 13, 2013
    Messages:
    49
    Likes Received:
    15
    Location:
    Beed
    Hi
    here is http://www.webprogrammingblog.com/introducing-geckofx-control/detail tutorial to automate same
     
  10. sohom

    sohom Senior Member

    Joined:
    May 26, 2013
    Messages:
    981
    Likes Received:
    175
    Location:
    not in Past
    selenium will be the best option ,I guess, cause selenium has the bigger community & cross platform support.