Scraping Linkedin Jobs

B

BuyProxies.com

Newbie

Jan 27, 2018

10

1

• Jan 29, 2018

• #21

DaVinci Tech said:

I'm not sure if this is a bad joke given that you're a proxy seller .

but that's not true.
If you do it the right way you, you can use one account to scrape thousands of jobs.

Click to expand...

This could be possible, but the request rate from 1 IP to avoid bans may be lower than what this person needs. Also, their web portal will implement a "big repository" of job posts; what if they need to scrape more than thousands of jobs? It was helpful to mention proxies since nobody mentioned it before and LinkedIn is strict with IP bans from scraping.

 

BlackHatRhino

Newbie

Jan 24, 2017

28

6

• Jan 29, 2018

• #22

Do you change the user-agent and other "browser" data that can identity you?
Yes, I agree that in most cases it is necessary to change the IP address, because many web services limit the number of requests from one IP address.

 

DaVinci Tech

Newbie

Jan 6, 2018

13

6

• Jan 29, 2018

• #23

The keyword is limit the number of requests per second or per a time unit.
If you write the bot correctly, you can browse LinkedIn undetected.

 

Altron

Newbie

May 18, 2018

31

8

• May 18, 2018

• #24

Is this for alt data in order to seek alpha or for actual employment?

 

dreadpixel

Banned - Selling outside marketplace

Jul 27, 2010

2,502

1,179

• May 25, 2018

• #25

Linkedin is so difficult to scrape and most of the time they are updating to avoid scrapers to keep doing their jobs.
Maybe you should try Selenium.

 

TasDePixels

BANNED

Mar 8, 2018

312

437

• May 25, 2018

• #26

Personally I always apply the same golden rule for scraping any website : unique user agent + rotating proxy + faking human behaviours (delay in typing and scrolling for ex) I never needed multiple accounts for Twitter or youtube it is however mandotary for facebook and LinkedIn.