How can I use proxies for my project?

Hello, I am developing an SEO Keyword rank tracking tool.

I use Google, Yandex and Bing as search engines.

When I send 10-20 requests from my own server, they block me. Because my requests are very fast.

One solution is to slow down my requests. However, then the waiting time of users increases.

How can I send requests from different ip addresses?

• Should I get a proxy block? Or can I solve it using free proxies?
• When I get a proxy or have a list, should I make a request like a user on that ip when making a request?
• Should I define a random user-agent for each ip?

If there is a documentation or a tutorial you can recommend on this subject, I would be very happy. Or I can read your experiences in the comments.

Thanks in advance.

Free proxies are useless as they get abused like anything (90% failure rate).

The only way you can bypass those blocks is by using private proxies which are reserved just for yourself. You can start with 5 to 10 private proxies and rotate them for each request, as your users increase add more proxies to the pool. Or better use web scraping api's, they are much more affordable and they only charge for succesful requests.

Yes setting a random user agent helps, but more ip's are always better.

I do not recommend free proxy. You can buy a proxy by spending small amounts of money.