OmniCapybara
Newbie
- Nov 1, 2024
- 1
- 0
Hello everyone,
I'm new here at BHW, and I would like to open a question for this community.
I've been working as a developer for a while and now we're focusing on
creating a method to scrape data from profiles across multiple social networks.
Obviously our team previously researched the rules
and terms and conditions of each social network and
we only limit ourselves to scraping publicly available data.
Among the social networks we cover (X, Instagram, TikTok, Facebook, Reddit, Etc),
there is one that has recently become much more difficult to scrape
and keep accounts with their cookies alive and that is LINKEDIN.
Lately linkedin detects very quickly (less than 24 hours)
the accounts we create to obtain the cookies and thus scrape public profiles.
We use dynamic residential proxies,
specifically we use Apify's residential proxy.
But with these problems we are considering changing Proxy to prevent more accounts from being exploited.
- What proxies or methods do you recommend?
- Is it true that LinkedIn uses HTTP3 QUIC and that it is therefore much easier to detect accounts that are used for scrapping?
- Is it true that the only way to avoid detection of Linkedin with HTTP3 QUIC is through a Residential VPN service like the one recommended to me https://www.resvpn.net/ ?
I would greatly appreciate any help and advice you can give me, thank you.
I'm new here at BHW, and I would like to open a question for this community.
I've been working as a developer for a while and now we're focusing on
creating a method to scrape data from profiles across multiple social networks.
Obviously our team previously researched the rules
and terms and conditions of each social network and
we only limit ourselves to scraping publicly available data.
Among the social networks we cover (X, Instagram, TikTok, Facebook, Reddit, Etc),
there is one that has recently become much more difficult to scrape
and keep accounts with their cookies alive and that is LINKEDIN.
Lately linkedin detects very quickly (less than 24 hours)
the accounts we create to obtain the cookies and thus scrape public profiles.
We use dynamic residential proxies,
specifically we use Apify's residential proxy.
But with these problems we are considering changing Proxy to prevent more accounts from being exploited.
- What proxies or methods do you recommend?
- Is it true that LinkedIn uses HTTP3 QUIC and that it is therefore much easier to detect accounts that are used for scrapping?
- Is it true that the only way to avoid detection of Linkedin with HTTP3 QUIC is through a Residential VPN service like the one recommended to me https://www.resvpn.net/ ?
I would greatly appreciate any help and advice you can give me, thank you.
