1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

I can scrape linkedin profiles

Discussion in 'Black Hat SEO' started by CosmicSoundz, Jan 31, 2013.

  1. CosmicSoundz

    CosmicSoundz BANNED BANNED

    Joined:
    Apr 30, 2012
    Messages:
    1,230
    Likes Received:
    1,296
    Hey guys. Ive been working hard on building my scrapper. I am able to scrape linkedin profiles. Previously I was looking for someone to do this for me but I said fuck it, I will make my own and I did.

    name
    location
    previous experience
    current work
    linkedin profile URL

    great for recruiters. Does anyone have any use for this here?
     
    • Thanks Thanks x 2
  2. balabala1221

    balabala1221 Junior Member

    Joined:
    Oct 5, 2012
    Messages:
    188
    Likes Received:
    9
    Occupation:
    Engineer
    Location:
    NYC
    can you get contact info from the ones that have it posted?
     
  3. CosmicSoundz

    CosmicSoundz BANNED BANNED

    Joined:
    Apr 30, 2012
    Messages:
    1,230
    Likes Received:
    1,296
    No. That info is only listed inside their profile. All the info I scrape is from the search results. But their linkedin profile URL along with name , skills etc will be included in a excel spreadsheet.
     
  4. redrubies

    redrubies Supreme Member

    Joined:
    Jan 17, 2011
    Messages:
    1,424
    Likes Received:
    2,560
    Location:
    USA
    Last year someone here gave thousands of linkedin email addys. If you do a search you might find it. I had that list and it was a good one.
     
  5. RantinRave

    RantinRave Registered Member

    Joined:
    Mar 29, 2011
    Messages:
    99
    Likes Received:
    17
    Yes, but I would need the ability to:
    1. Specify the search criteria .. current job title, industry, zip code radius, etc.
    2. Ability to tell if it's an OPENLINK profile

    I'm more than showing you what I'm talking about PM me if you want to skype it up and I can share my screen.
     
  6. schwagoo

    schwagoo Jr. Executive VIP Jr. VIP Premium Member

    Joined:
    Nov 8, 2010
    Messages:
    807
    Likes Received:
    737
    Location:
    Midwest, USA
    Congrats for "doing it yourself". That is by far the best way to get things done. You learn, and you can now apply that knowledge to your next project. +rep
     
  7. the_demon

    the_demon Jr. Executive VIP

    Joined:
    Nov 23, 2008
    Messages:
    3,177
    Likes Received:
    1,563
    Occupation:
    Search Engine Marketing
    Location:
    The Internet
    Doing it yourself is not at all the best way to get things done @ schwagoo... A smart way of doing business is hiring the best people for the job and focusing on what you're good at. You think the CEO of Coca Cola programs their website, lmao

    A good manager knows how to delegate and utilize time efficiently, not waste 6 months of money making time to learn how to code.

    A friend of mine and myself did a similar project, but instead of wasting months worth of time, we got the bots required programmed in a couple days (for a couple hundred bucks) and within a few days mined hundreds of thousands of linked in member data and had it compiled for us nicely in a CSV separated, filtered, and mailed. Practically on auto pilot and churned out thousands in profits (we didn't mail the whole list, so plenty more cash left to make too).

    A smart business man realizes how to maximize revenue potential, in the least amount of time without impairing potential earnings to a significant degree.

    Example 2: Pretty sure Bill Gates hasn't been working on Microsoft products since the days of MS-DOS, lol
     
    • Thanks Thanks x 3
    Last edited: Feb 2, 2013
  8. bfly1

    bfly1 Registered Member

    Joined:
    May 30, 2011
    Messages:
    86
    Likes Received:
    8
    Congrats on learning something new, I could have this running in under 30 minutes though
     
  9. joe8489

    joe8489 Newbie

    Joined:
    Mar 9, 2013
    Messages:
    2
    Likes Received:
    0


    hi CosmicSoundz and all other readers on this thread,

    i'd certainly have use for such a scraper, let me know what the next step is ..

    Anyway, a bit of about me and what im ultimately after:

    i'd be keen in engaging someone who can scrape data from linkedin. Namely, from LinkedIn's search results page, which only gives you 10 contacts per page. I need approximately 5,000 of them, so thats 500 pages one would have to go through manually.

    I am a recruiter, specializing in accounting & finance. I have database of 2,000 accounting contacts (Australia) and it mainly consists of:

    - Financial Controllers;
    - Finance Directors;
    - CFOs;
    - Finance Managers:
    - Financial Accountants.


    75% of my database is up to date, so 1,500 contacts are still at the same company. That means that 500 or so contacts have either left company, or changed positions within the company, or company has been liquidated, sold, bought out etc.

    I wanted to be able to clean up my existing database using LinkedIn but the clear limitation is the 10 results per page. Which wouldnt be huge problem if the search results amounted to 70, leaving me only 7 pages to trawl through. However, my search generates a set of results in the order of 18,523, based on the below search criteria.

    COUNTRY
    - Australia
    TITLE - "Financial Controller" OR "Finance Director" OR "CFO" OR "Finance Manager" OR "Financial Accountant"
    CURRENT & OR PAST - Current


    18,523 equates to 1,853 pages. Even going through only a tenth of that would render the exercise commercially not viable.

    If you were able to get 100+ results per page (ie. like an ebay), then the task would not be so laborious.

    If I was to undertake such a process with search results of say 120+ contacts (12 pages), then the steps I'd take would be as follows:

    1.
    Shrink screen to say 50% (so that i can see all 10 results. With this view, I can also select the next page without having to scroll down or up)
    2. CTRL "F", search for the word "More", which will then be highlighted in yellow thus making it easier to identify.
    3. Click the first instance of "More" in contact. In 90% of cases, the first "More" will relate to the contacts "current" job.
    4. After having now expanded each of the 10 contacts' current job, I will then hit CTRL "A" (Select All)
    5. Then CTRL "C"
    6. CTRL "V" into an Excel spreadsheet (but before it goes into excel, i'll dump it into "Notepad" so that it loses its formatting, resulting in a cleaner dump into excel.
    7. I then play around with that data in such a way that i'm able to get what i need, efficiently. I then do a v-lookup with the data I already have (my database). I am all set from here onwards.


    I'd be very keen to see if you could help me out on this and what the process would involve

    btw, I have a premium account (business plus), which i'd be more than happy for you to jump into if you wanted to have a peak around.
     
    Last edited: Mar 10, 2013
  10. joe8489

    joe8489 Newbie

    Joined:
    Mar 9, 2013
    Messages:
    2
    Likes Received:
    0
    An email blast would help me qualify my existing ones but it wouldn't give me new ones.

    I'd also want to be able to obtain new contacts, their names, titles, companies.

    An email blast would simply give me a failure notice.

    I was hoping their was an existing code or program for such a query given it sounds like a fairly common one.

    Is that similar to what cosmicsoundz
    was offering in the first post?

    Thanks
     
  11. psr1612

    psr1612 Newbie

    Joined:
    Apr 1, 2013
    Messages:
    6
    Likes Received:
    0
    what is the cost of the software bro??let me know please .cheersSurya
     
  12. saydulk

    saydulk Newbie

    Joined:
    Aug 4, 2013
    Messages:
    2
    Likes Received:
    0
    Occupation:
    coder
    Location:
    comilla
    Yes I am trying to scrap data from LinkedIn. Input: domain. Output: Company Name, Company Description, # of Employees, Active/Closed, Locations. Do u help me?
     
  13. Thesiege84

    Thesiege84 Regular Member

    Joined:
    May 5, 2009
    Messages:
    360
    Likes Received:
    97
    Occupation:
    Money Churner
    Location:
    Churning Money
  14. cwmcleveland36

    cwmcleveland36 BANNED BANNED

    Joined:
    Aug 8, 2013
    Messages:
    5
    Likes Received:
    0
    will this pull phone and emails?
     
  15. dono0034

    dono0034 Newbie

    Joined:
    Nov 12, 2012
    Messages:
    1
    Likes Received:
    0
    Hey CosmicSoundz

    I would be interested in this tool for list building. Please DM me the details. Thanks!
     
  16. Junefog

    Junefog Junior Member

    Joined:
    Jul 24, 2013
    Messages:
    101
    Likes Received:
    28
    Just curiously asking, but what language did you use to program the bot? Great job by the way :)
     
  17. bogos

    bogos Newbie

    Joined:
    Sep 1, 2013
    Messages:
    5
    Likes Received:
    0
    i need email for puchasing manager in hospitality industry, and as far as i know linkedin has the most possibilies to look the email. What do you guys think? or anyone could help me?
     
  18. brockmeister

    brockmeister Newbie

    Joined:
    May 8, 2013
    Messages:
    13
    Likes Received:
    2
    You cannot scrape e-mails from LinkedIn profiles, except for the people you are connected to (in which case LinkedIn has a convenient feature that lets you download all the e-mails in a CSV file). However, you can send LinkedIn messages directly to people you want to reach. I do this a lot. However, recently LinkedIn has been getting stricter in suspending accounts that send unsolicited e-mails and I haven't figured out the limits of their new algorithms yet. I would love to share insights about the ins-and-outs of sending messages on LinkedIn if anyone wants to PM me.
     
  19. plummer

    plummer Registered Member

    Joined:
    Nov 17, 2009
    Messages:
    70
    Likes Received:
    1
    whats the name of the software?
     
  20. manross

    manross Newbie

    Joined:
    Sep 23, 2013
    Messages:
    1
    Likes Received:
    0
    I'm very interested in getting access to LinkedIn profiles - ideally people working in retail/luxury in Europe. would be good to get more details.