car rental website without an api question

[dillywilly]

Hello im interested in building a car rental pricing website but the website that i want to pull data from dont have an api. Is it possible to get a script built and have the script pull the necessary data/info and mirror to my website via script and display the results? and how stable is this angle and will it need constant upkeep ? even thought the website rarely makes changes / updates

thanks in advance

 

[Smackhead]

yeah, you could hire someone to do this. it would only require upkeep if the source site was to change. Another challenge comes if you want to retrieve the data at a high frequency as it's possible the site could detect your scraper and block you, lots of ways around this but sounds like it's probably not an issue in your case.

 

[dillywilly]

yeah, you could hire someone to do this. it would only require upkeep if the source site was to change. Another challenge comes if you want to retrieve the data at a high frequency as it's possible the site could detect your scraper and block you, lots of ways around this but sounds like it's probably not an issue in your case.

it wouldnt be a high frequency retrieving data it would probably do about 500 requests per day max compared to the millions of visitors it gets daily

 

[TheNumbersGuy]

Any data sent from a website is an api, you just needa know how to make your own api to it. Either parsing the HTML or getting json data.

 

[dillywilly]

Any data sent from a website is an api, you just needa know how to make your own api to it. Either parsing the HTML or getting json data.

what skill would i need to hire for this task ?

 

[ProxyDIY]

You need to reverse engineer the API. It's not easy but you can start by pressing F12 on Chrome go to Network tab and look at the request being sent and received. You can filter for GET or POST methods and more.

This is more challenging to do on modern websites.

 

[hexagonal]

The cheapest option is hiring someone to scrape the results another one is doing reverse engineering of the API but that takes more time and money.

 

[TheNumbersGuy]

what skill would i need to hire for this task ?

depends on the security the site is implementing, if its a small site, its probably very easy to make an api to. Other sites that implement anti botting, or use javascript to render results increases the difficulty of extracting the information.

 

[dillywilly]

depends on the security the site is implementing, if its a small site, its probably very easy to make an api to. Other sites that implement anti botting, or use javascript to render results increases the difficulty of extracting the information.

are you able to look at it and tell me if its possible ?

 

[Array Experts]

Post in hire a freelance section there are many good coder in forum who can help to develope your own custom scraper as per your need

 

[TheNumbersGuy]

Post in hire a freelance section there are many good coder in forum who can help to develope your own custom scraper as per your need

This, I am not looking to do a service like this. But you can find someone in a freelance section. Everything is possible to rip, so theres not a limit on being able to acquire what you are looking for.

 

[ibobo]

Hi, I did this kind of project few days ago, it could be easy or not.
The difficulty will depend of the website source, doesn't matter big or small, both can have security to make it difficult.

As the price changes according to the demand and season you ll probably need to run It multiple times to update your price as well ?

 

[smmturk]

For this, you can request api from car rental websites. Or you can search with 1-2 words on github.