anyone experimenting with AI for automated bot use/development?

i hope this is the right subforum for this post. please move it if i'm mistaken.

i believe most of us here are experienced with writing bots to automate web actions - either using raw http requests or projects like Selenium/Playwright for browser emulation. as i'm working on a new pc built for, in part, AI use i've been researching and collecting projects that may be applicable for IM and other use-cases. below are some solutions i've come across thus far. it seems that with these tools, rather than hard-coding DOM stuff as is tradition, you can tell the LLM in natural language the actions you want the bot to take. it will then generate code to do so. this seems very promising and i'm curious if any of you have used such projects and if so what has your experience been like. i realize this tech is still learning to walk, yet i can for example see using such models several times to come up with multiple "templates" to perform the bot actions, which can then be tweaked to make them appear even more human-like. self-healing bots too, which adapt to changes to the target. i'm not yet aware of any similar projects targeting mobile applications, but i do expect there will be some.

cheers BHW. the more i dig the more i start to realize this tech will be game-changing!

https://github.com/lavague-ai/LaVague

https://github.com/Skyvern-AI/Skyvern

https://github.com/handrew/browserpilot

also, do share other related projects you've come across

Whatever project u undertake, don't ever use selenium, the chrome driver is full of random bugs, which u will never solve.

Yeah I checked out Skyvern and went through the source code of an early release of LaVague (IIRC it was chunking the source code and using BM25 to find the relevant chunk) - - around 6 months back IIRC. At the time both were pretty unreliable. Have they improved since then?

I’ve been messing around with some of the tools you mentioned, like LaVague and Skyvern, and it’s honestly mind-blowing how you can just describe what you want in plain English and the ai spits out code to make it happen. It’s like having a coding buddy who doesn’t complain about your coffee breath. ))
I’ve also been playing with https://github.com/handrew/browserpilot, and while it’s still early days, the idea of self-healing bots that adapt to changes in the DOM is super exciting. No more pulling your hair out because some website decided to randomly change a class name, right? I haven’t seen much for mobile apps yet, but I’m betting it’s only a matter of time before someone cracks that nut. Honestly, I think this tech is going to be a game-changer for automation. It’s not perfect yet, but even now, it’s saving me a ton of time.

You're absolutely right that this technology is game-changing. It has the potential to significantly reduce the time and effort required to develop and maintain web automation bots. However, it's important to be aware of the challenges and limitations and to approach these projects with a healthy dose of skepticism and rigorous testing.