1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Building website scraper and content aggregator!

Discussion in 'Hire a Freelancer' started by gnr2206, Oct 4, 2015.

Tags:
  1. gnr2206

    gnr2206 Registered Member

    Joined:
    Jul 22, 2013
    Messages:
    70
    Likes Received:
    5
    HEY BHW

    Just looking for some advice on a project I'm trying to build at the moment. In a nutshell, I'm building a website that work like a skyscanner for sneakers. A users comes to the site, type the shoe they want "nike air force one" and they get back a list of the cheapest sneakers and where to buy them

    How can I go about creating this in the most efficient way possible? I have a list of sites I want to scrape from but I don't know how to get started. We got a budget so maybe if you can build something for us we could pay

    Thanks,
     
  2. jamie3000

    jamie3000 Supreme Member

    Joined:
    Jun 30, 2014
    Messages:
    1,377
    Likes Received:
    626
    Occupation:
    Finance coder looking for semi-retirement
    Location:
    uk
    if possible you don't want to scrape at all. HTML is not designed to be programmatically read that way. You'd want to use websites that offer an API designed for gathering information about their products. If you have to scrape I would recommend PHP+XPATH :)
     
  3. gnr2206

    gnr2206 Registered Member

    Joined:
    Jul 22, 2013
    Messages:
    70
    Likes Received:
    5
    thanks for the comments!

    can explain that to me further? how does skyscanner get the latest up to date info on products from loads of different providers?
     
  4. kacsatejfol

    kacsatejfol BANNED BANNED

    Joined:
    Mar 26, 2015
    Messages:
    65
    Likes Received:
    5
    Hi OP, able to build these kind of scraper, kindly send me a Pm if you are interested