Scraping Indeed.com

TheMoneyHat · Mar 27, 2017

A client wants to scrape Indeed.com for a specific kind of job listing to add to their site.

They are a job training site and they want to add job listings to their training site.

Basically, they want a "white labeled" indeed.com feed.

I do have Indeed's JobRoll on their site but the want the feed without the Indeed.com logo.

My questions are:

1. is this possible
2. is it a good idea

Thanks for your thoughts.

Hexiuss · Mar 30, 2017

Assuming they read indeed publisher programs ToS and are in compliance I don't see why not. Just use CSS to display:none; the logo.

sergenthw · Mar 30, 2017

Are you using python?
Do you use query the keyword and scrape or just type url with parameter?
Show me some image or snippet of your code to clarify the problem

BlueSnow · Mar 30, 2017

You don't need to scrape anything. They will actually pay you to backfill your site with their jobs. It's not much, something like 180 USD for 50k clicks (around 3,6 $ cpm), but it's better than free. Just join their publisher program and you will find tools there.

Or use WP plugins for Indeed integration.

BassTrackerBoats · Mar 30, 2017

Are you looking to strip the links from them as well?

blogzandstuff · Mar 31, 2017

surely you can just add them, they have a publisher program
https://www.indeed.co.uk/publisher

TheMoneyHat · Apr 3, 2017

sergenthw said:
Are you using python?
Do you use query the keyword and scrape or just type url with parameter?
Show me some image or snippet of your code to clarify the problem

I'm just using their JobRoller script on my site. The problem is that previously the they had much bigger results. The new script has less results and a bigger logo. I'm just looking to see if anyone has a workaround script or an idea of how this can be done.

TheMoneyHat · Apr 3, 2017

blogzandstuff said:
surely you can just add them, they have a publisher program
https://www.indeed.co.uk/publisher

Right - I have that but I'm looking for a solution that pulls in more results -

TheMoneyHat · Apr 3, 2017

BassTrackerBoats said:
Are you looking to strip the links from them as well?

No - we want the results - it's a job posting site - we just want better results - hoping someone might have a workaround

Scraping Indeed.com

TheMoneyHat

Registered Member

Hexiuss

Junior Member

sergenthw

Regular Member

BlueSnow

Regular Member

BassTrackerBoats

Support Admin

blogzandstuff

Elite Member

TheMoneyHat

Registered Member

TheMoneyHat

Registered Member

TheMoneyHat

Registered Member

Main Menu

Marketplace

Making Money

BlackHat World