Bot technology

Start with manual browser. Then make your automated browser work like it was a manual one. You should think in terms of online identities, not in terms of proxies. You can utilize the same IP dozens of times but you must understand you must behave like a real user.
 
Recommending python + selenium.

python + requests + BeautifulSoup are a good way to start, but many sites may have anti-scraping technology that will catch this.
 
I started with the simplest of setups - Browser + Pulovers Macro Creator. Great way to get started on how automation works. Then move into one of the many options mentioned on this forum and thread.
 
Use puppeteer + stealth addon (usually with Javascript/Python)

If you want more speed/concurrency then use Golang.
Thanks Audience grow, what is the set-up for golang ? Familiar with python and JavaScript but need to research golang.
 
Thanks Audience grow, what is the set-up for golang ? Familiar with python and JavaScript but need to research golang.
You can use chromedp, playwright-go, etc depending on what you'd be most comfortable with. The advantage of using Golang is ease of concurrency and performance gain by using worker pools and job queues (via goroutines).
 
You can use chromedp, playwright-go, etc depending on what you'd be most comfortable with. The advantage of using Golang is ease of concurrency and performance gain by using worker pools and job queues (via goroutines).
Interesting stuff.
 
You can use chromedp, playwright-go, etc depending on what you'd be most comfortable with. The advantage of using Golang is ease of concurrency and performance gain by using worker pools and job queues (via goroutines).
Thanks again very useful information.
 
Back
Top