Discussion in 'Programming' started by PowerPath, Aug 19, 2018.
Go with python or node.js
Can you send me a DM so I can respond to it I have a couple questions?
Yeah cloaking bots is super hard if the site has their act together, although a lot don't. Some of them will actually check the order the headers come back in. PhantomJS is a good call but some very very few, sites still ban it. The other alternative is a firefox plugin. It's how Java is connected up to firefox in automated testing suites like selenium. You can use selenium (leaves a marker, you can manually edit the plugin to remove it) or you can you can directly code firefox js for maximum customizability. For headless operation you can throw it onto a new X display in linux. There are ways to start multiple copies of firefox if you really needed to as well, but I forget them atm. Might be related to firefox profiles.
I hate to be the one to say this, but I really liked UBot Studio for this kinda stuff. Its really up-to-date with features and all of a botter's needs.
- The scripting language could be better
But its still pretty damned impressive, right down to handling captchas and thread forking, you name it.
python bro , u get the power and flexibility .
Well, if you want to have your bot more power, then use the selenium webdriver. It has different coding language bindings. Java is recommended in this case.
Read more about selenium. Its a must have for web automation scripting.
In any other case, python is also good since its very light weight
I think Python would be the best cause you have many libraries better than .NET.
.NET components are usually sold when using Visual Studio.
Python has Tensorflow and other open source libraries to easily integrate with your bots, besides it is used for Data Science. Bots depends on data to operate properly.
I think any programming language you feel comfortable with. There is really no difference between PHP or Python as long as you can master the specific language. However, if it comes to libraries availability, some languages have more variety of tools - both Python and NodeJS have a quite active community around bots/crawlers/scrapers so very likely you would want to start with Python or NodeJS.
I'd like to add that there are selenium bindings for python too! It's how I use selenium
Separate names with a comma.