Experience scraping LinkedIn, any tips?

jamie3000

Elite Member
Executive VIP
Jr. VIP
Joined
Jun 30, 2014
Messages
13,753
Reaction score
5,226
I'd have a huge list of UK companies and I'd like to find out how many employees each one has. The best source I've found so far is their LinkedIn pages. However, Linkedin is notoriously difficult to scrape because of the value of their data.

So before I begin does anyone have any tips?

I know the basics/usual.

Clean proxies
Rotate user agent
Human-like delays etc

I wanted to pull it out of a search engine cache but it looks like they've got the no-cache thingy tag on their pages.

Tips? Thoughts anyone?
 
I used to scrape LinkedIn before. You will need a lot of accounts + proxies + user agents + delays. Basically the same thing as in any social media, don't be online with the same acc 24 hrs, act like a normal human and that's it. You will also need to implement captcha solving as linkedin has google recaptcha in their system
 
LinkedIn knows people are trying to scrape data and they're MAD about it.
They're even giving warnings to normal users who just visit profiles manually.
Yes, I'm talking from personal experience. So, I'd be really careful with that.

Ban is a real option.
 
Skrapp and E-reval are 2 ways to get emails from linkedin. IMO Skrapp is 10x better than E-reveal.
 
Back
Top