Discount Scraper Script / Service / Plugin ?

kamikaza said:

I am looking for a script/plugin that can scrape certain categories of deals (eg. camping tents) dailiy - on Amazon, home depot and some niche shops for discounts and place these deals on my website (like frontpage deals @ slickdeals.net)

Are there any ready solutions for this purpose? Please advice

Click to expand...

1. Identify the websites you want to scrape: In your case, you mentioned Amazon, Home Depot, and some niche shops. Make a list of the websites you want to scrape deals from.
2. Determine the categories and filters: Identify the categories and filters that you want to apply to your search. For example, you may want to search for camping tents that are on sale, or have a discount of more than 30%.
3. Choose a web scraping tool: Choose a web scraping tool such as BeautifulSoup or Scrapy to extract the data from the websites you want to scrape. These tools will help you parse the HTML of the websites and extract the relevant information.
4. Set up your scraper: Set up your scraper to run daily and search for deals based on the categories and filters you have chosen. You can save the data in a structured format such as a CSV file or a database.
5. Display the deals on your website: Once you have the data in a structured format, you can display the deals on your website. You can use a front-end framework such as Bootstrap to create a responsive design and make the deals look appealing.
6. Automate the process: To ensure that the deals are updated daily, you can set up a cron job to run the scraper automatically at a specific time every day.

maksymS said:

Here are the steps you can follow to scrape deals from different websites and place them on your website:

1. Identify the websites you want to scrape: In your case, you mentioned Amazon, Home Depot, and some niche shops. Make a list of the websites you want to scrape deals from.
2. Determine the categories and filters: Identify the categories and filters that you want to apply to your search. For example, you may want to search for camping tents that are on sale, or have a discount of more than 30%.
3. Choose a web scraping tool: Choose a web scraping tool such as BeautifulSoup or Scrapy to extract the data from the websites you want to scrape. These tools will help you parse the HTML of the websites and extract the relevant information.
4. Set up your scraper: Set up your scraper to run daily and search for deals based on the categories and filters you have chosen. You can save the data in a structured format such as a CSV file or a database.
5. Display the deals on your website: Once you have the data in a structured format, you can display the deals on your website. You can use a front-end framework such as Bootstrap to create a responsive design and make the deals look appealing.
6. Automate the process: To ensure that the deals are updated daily, you can set up a cron job to run the scraper automatically at a specific time every day.

Click to expand...