C# Headless Browser, Multithreads

N

novalagoon

Newbie

Jan 20, 2013

17

2

• Nov 9, 2013

• #1

I have read the posts here in the forum but couldn't find an answer.

I want to write a multithreaded bot, which can process sites with a lot of ajax. What's the best liabrary, webbrowser control, to use with c# achieve this?

Thanks

 

K

KirtiD

Newbie

Jun 13, 2013

49

15

• Nov 12, 2013

• #2

You can use xulrunner & Geccofx it support java script,ajax etc also well documentedYou can find lots of help on its web site, let me know if you need any help

 

K

KirtiD

Newbie

Jun 13, 2013

49

15

• Nov 12, 2013

• #3

You can use xulrunner & Geccofx it support java script,ajax etc also well documentedYou can find lots of help on its web site, let me know if you need any helpYou can use Awesomium which support headless as well as browser baseI am not very sure about full ajax ,java script support in headless browser

 

N

novalagoon

Newbie

Jan 20, 2013

17

2

• Nov 18, 2013
• Thread Starter Thread Starter

• #4

Thanks for your answer, can you please point me a little bit more in the right direction?

I downloaded GeckoFX-22.0 and XulRunner 22.0, copied XulRunner to the GeckoFX folder and compiled the solution. Now I have the DLLs but don't know where to get started now?

(Awesomium can handle JavaScript and Ajax, at least for what I needed, but it's not thread-safe)

Regards,
nova

 

rootjazz

Elite Member

Dec 21, 2012

3,166

1,190

• Nov 22, 2013

• #5

IIRC you can get awesomnium to work multi threaded, takes a bit of coding around, but it is possible. Or it was. But it was quite buggy as a headless browser to really use when I last checked.

 

rootjazz

Elite Member

Dec 21, 2012

3,166

1,190

• Nov 22, 2013

• #6

IIRC you can get awesomnium to work multi threaded, takes a bit of coding around, but it is possible. Or it was. But it was quite buggy as a headless browser to really use when I last checked.

 

N

novalagoon

Newbie

Jan 20, 2013

17

2

• Nov 23, 2013
• Thread Starter Thread Starter

• #7

Thanks for your answer, rootjazz, I think I will give GeckoFX a try. I got it working and can browse sites, etc.

But I have some issues with ajax (e.g.: if a control loads additional data, for example if you type something into google search, the autosuggest does not load).

Another question that arose is, how to go headless, do I use the forms control and just don't display it?

I can't find a decent documentation for GeckoFX, does anyone know some useful ressources?

Nova

 

rootjazz

Elite Member

Dec 21, 2012

3,166

1,190

• Nov 25, 2013

• #8

Try selenium with phantom JS (ghostdriver).

 

K

KirtiD

Newbie

Jun 13, 2013

49

15

• Nov 28, 2013

• #9

Hi
here is http://www.webprogrammingblog.com/introducing-geckofx-control/detail tutorial to automate same

 

sohom

Supreme Member

May 26, 2013

1,361

646

• Aug 18, 2014

• #10

selenium will be the best option ,I guess, cause selenium has the bigger community & cross platform support.