How do bots interact with a web page?

watchintv

Junior Member
Joined
Oct 2, 2014
Messages
115
Reaction score
29
I've used Selenium in the past.

How is this done typically?
 
Use chrome devtools to inspect the webpage and find elements by any attribute, you could also use the XPath to interact with elements

Here's a small example https://gist.github.com/miguelmota/a321d3332d6916b68933cdf2da5e173e

Screenshot 2023-01-17 at 10.00.26 PM.png
 
You are correct. Selenium is most popular to automate tasks.
If you check YouTube, there are many tutorials on how to use Selenium to interact with websites.
 
Either by connecting to the APIs behind the Web page or via browser automation such as selenium.

Interacting with the APIs will be more performance but more complex to handle things like authentication.

Playwriting and puppeteer are alternatives to selenium which you might also find useful.
 
Either by interfacing with the APIs behind the Site page or through program computerization like selenium. Connecting with the APIs will be more execution yet more perplexing to deal with things like verification. Playwriting and puppeteer are options in contrast to selenium which you could likewise see as helpful.
 
ChatGPT write great web scrapers using selenium web driver. Just tell it what website you want to scrape and what info you are interested in.
 
ChatGPT write great web scrapers using selenium web driver. Just tell it what website you want to scrape and what info you are interested in.
Very cool information. I will try this!
 
Back
Top