Interesting topic!
Here is my go to move with Python for Web automation & Web scraping.
API = requests
Simple website = requests with beautifulsoup
JavaScript generated websites = Scrapy with scrapy-splash
Simple form submits = Scrapy
Lots of form = Selenium
I am still learning &...
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.