Scraping LinkedIn with pyothon requests only ?

hideath said:

i've did a little test a year back in time and it worked just fine,
you'll probably get the ip banned much faster tho,

well at least that was my case,
idk if it could be related to cookie expiring too,
didn't take much time to test

Click to expand...

goodbye tobey said:

I'm using proxies to prevent banning, but I think they track account activity instead of the ip. I'm only having success scraping public profiles, private ones are much harder to scrape.

Click to expand...

hideath said:

well, never digged enough to scrape the private ones,
it won't take as much time/resources for testing things out tho, just be patient ^^
good luck man ^^

Click to expand...

goodbye tobey said:

Can I scrape LinkedIn using only requests with sessions & cookies, or should I use browser automation?

Click to expand...

NachoMan said:

I've done it with browser automation, works ok. Linkedin can be tricky some times. And yes definetly use proxies

Click to expand...