Scraping Contacts from Indeed

Hey guys, i am quite familiar with scraping data from websites. I have specifically used Jarvee to scrape tens of thousands of emails and other contact details from both Instagram and LinkedIn.

However, I am currently in a career role as the website manager for a b2b company. I have a few colleagues in the sales department who are cold calling. I just spoke to one, and he has been manually crawling Indeed and scraping the phone numbers from companies who post job applications (hiring).

I KNOW there is a way to automate this. I have done nearly this same thing, just not on Indeed. I also know that people are successfully scraping Indeed for job postings themselves. So this should be easily achievable.

If anyone has some suggestions on the stack i would use to achieve this, i would appreciate any insight into this. This is something I'd love to set up for them. It would also make me look good, you know?? Thank you to anyone who engages in this dialogue and helps me figure this out!

I'm currently scraping Company information from Indeed URLs. However, it isn't giving me their phone numbers.

The only data it scrapes for me is the job details link, company name, location, salary, job review count, job type, job description, email (only like 1 in 20 actually have this), Job posted date, valid through data.

I need a system where I pull their phone numbers because these are used to build a database of highly targeted contact numbers for our sales team's cold-calling team.

Is there any streamlined method where I could take the exported Excel info and somehow input the company names for an output of their phone numbers??

If phone numbers aren't part of the data displayed by Indeed, you can take each company's website url, which seems to be present. Scrape the homepage, and maybe try and identify a contact page from extracted internal urls, and try to pull any phone numbers from the html of the home page and any contact page via pattern matching.

Steptoe said:

If phone numbers aren't part of the data displayed by Indeed, you can take each company's website url, which seems to be present. Scrape the homepage, and maybe try and identify a contact page from extracted internal urls, and try to pull any phone numbers from the html of the home page and any contact page via pattern matching.

Click to expand...

YES!! This is probably the most direct method to achieve this. I appreciate you brainstorming with me! It just broke my heart hearing the kid tell me he comes in at 6:30 am to start scrolling down Indeed, lol.... I cannot believe how much of what they do here is manual.

I really hope they allow me to update the automation we have here. I can get our efficiency up so much by implementing things like this.