1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

LinkedIn scrapper works on home PC but not on server

Discussion in 'Programming' started by sovellis91, Apr 28, 2017.

  1. sovellis91

    sovellis91 Newbie

    Joined:
    Sep 4, 2016
    Messages:
    1
    Likes Received:
    0
    Hi guys.

    We wrote a LinkedIn scrapper using Selenium. The script works fine when we run it on our home PC machine along with proxy IPs. However, when we run the same script on a remote server (again using same proxy IPs) LinkedIn instantly redirect us to login (i.e. block us)

    Do you have any ideas what LinkedIn might be detecting that is different on the server VS our the home PC? We run the exactly same configuration, same proxies, same OS (linux), same user behavior, etc.

    Would really appreciate if you have any tips? Happy to pay for a consultation if you have experience in LinkedIn Scrapping
     
  2. Jomasdf

    Jomasdf Jr. VIP Jr. VIP

    Joined:
    Jul 7, 2012
    Messages:
    458
    Likes Received:
    158
    Occupation:
    C# dev
    Location:
    Sweden
    Home Page:
    Hard to tell. LinkedIn sometimes works and some times don't for me. I haven't had any problems with Selenium + PhantomJS though. Cefsharp does however.
     
  3. Dan21

    Dan21 Registered Member

    Joined:
    Aug 13, 2016
    Messages:
    68
    Likes Received:
    4
    Gender:
    Male
    Could be the headers you are passing, could be the fact that you are not using a proxy properly or your proxy is leaking your IP address. Could be a million things, if you want I am happy to look at your code for an hourly rate.
     
  4. Javardo69

    Javardo69 Junior Member

    Joined:
    Jul 19, 2014
    Messages:
    106
    Likes Received:
    6
    so you just login and scrape while logged in hehe
     
  5. codefoxdens

    codefoxdens Newbie

    Joined:
    May 8, 2017
    Messages:
    41
    Likes Received:
    5
    Gender:
    Male
    Check the sessions.
     
  6. Gurpreet Kaur

    Gurpreet Kaur BANNED BANNED

    Joined:
    May 12, 2017
    Messages:
    24
    Likes Received:
    2
    Gender:
    Female
    Please remove cache or history then try again . May be its working properly.