What you want to see in modern scrape systems?

Hi everyone, I am researching marketplace and there are only few systems that allows user automatically scrape users from Instagram or other social media.

I am interested in your opinion about what exactly you want to see in modern scrape systems and what is missing in current solutions?

Also, I am thinking of develop new scraping system that will be much reliable and comfortable for users, that’s one of the reasons why I ask you BHW

Reliability seems to be the biggest issue. Do you use proxies for these systems? I'm curious how they work generally.

Sure, proxy is most important thing to working without blockings from instagram side. I wonder to use mobile proxies combined with normal proxies, because Instagram really fast determines automatic actions, especially from desktop browsers.

As you pointed out, I believe proxies are usually posing the biggest issue. I think that a reliable tool that takes care of proxies (without the end-user having to figure that part) could be priced fairly high.

What proxy issues are you guys having with social media sites? I have yet to have anything related negatively on regular Data center networks. Maybe people are buying shared which would be the obviously flawed or even socks from vpns. Social media is least of concerns in the world of scraping.

Where the world of scraping crashes with the reality of today is Zero Trust measures . Best IPs or not , it will get screwed like the rest.