Building website scraper and content aggregator!

HEY BHW

Just looking for some advice on a project I'm trying to build at the moment. In a nutshell, I'm building a website that work like a skyscanner for sneakers. A users comes to the site, type the shoe they want "nike air force one" and they get back a list of the cheapest sneakers and where to buy them

How can I go about creating this in the most efficient way possible? I have a list of sites I want to scrape from but I don't know how to get started. We got a budget so maybe if you can build something for us we could pay

Thanks,

if possible you don't want to scrape at all. HTML is not designed to be programmatically read that way. You'd want to use websites that offer an API designed for gathering information about their products. If you have to scrape I would recommend PHP+XPATH

thanks for the comments!

can explain that to me further? how does skyscanner get the latest up to date info on products from loads of different providers?

Hi OP, able to build these kind of scraper, kindly send me a Pm if you are interested