are you a cybersecurity expert ?

[Zhen]

If you gonna web scraping data from a website, what you will do to avoid being detected ?

 

[Mike Z]

Web scraping is legal.

 

[blackmoon_]

If you gonna web scraping data from a website, what you will do to avoid being detected ?

depends on the website commonly you'll need cloudflare bypass, anti bot systems commonly review your activity and behaviour in order to verify whether you are a human or not, you'd need a way to bypass that, there are anti detect browsers and libraries easy to find on github

 

[mariafili]

If you gonna web scraping data from a website, what you will do to avoid being detected ?

To avoid detection use rotating proxies, set random delays between requests and mimic human behavior by varying browser headers and user agents

 

[EndlessWorlds]

Use proxies. I use mobile proxies and I havent had a problem. Even in the early days before I figured it all out, had some IPs that got banned but with a proxy, all I had to do is get a new IP address.

 

[ImDanTheMan]

Use proxies. I use mobile proxies and I havent had a problem. Even in the early days before I figured it all out, had some IPs that got banned but with a proxy, all I had to do is get a new IP address.

Any affordable ones all of then are so expensive i just looking for one per ip or something.