Mr.Businessman
Registered Member
- Jul 25, 2022
- 60
- 13
Hi, I'm planning to make a bot that detects discounts on amazon products, however I have few things on my mind.
1. How can I scrape the all products, or at least prime products.
I thought I can first scrape the categories first then iterating through each category I can collect first X pages with the product IDs. But is there any other way?
2. How can I get the price of an specific product?
For this I'm thinking to get HTML page and parse the price, sincethere is no API of Amazon I was able to find, maybe I can give it a go on the mobile app by reversing it but if I'm not mistaken it was also returning HTML so there is no publicly available API. Is there any other way you think of?
3. How should I store the data?
I'm planing to use an SQL database here, any thoughts or recommendations?
Thanks for your time and I appreciate any kind of feedback.
1. How can I scrape the all products, or at least prime products.
I thought I can first scrape the categories first then iterating through each category I can collect first X pages with the product IDs. But is there any other way?
2. How can I get the price of an specific product?
For this I'm thinking to get HTML page and parse the price, sincethere is no API of Amazon I was able to find, maybe I can give it a go on the mobile app by reversing it but if I'm not mistaken it was also returning HTML so there is no publicly available API. Is there any other way you think of?
3. How should I store the data?
I'm planing to use an SQL database here, any thoughts or recommendations?
Thanks for your time and I appreciate any kind of feedback.