Best Web Content Extractor/Scraper?

[Badjoras]

Hi all!

I'm starting to build an ecommerce aggregator for a certain fashion niche. Therefore, I'm trying to find the best webscrapping tool/service over there.

I need to extract basic content such as: Product Name, Brand, Store, Price, Sale Price, Size, Color, Material and Product Image.

There are many services but I'd like to hear your opinion.

Thanks!

 

[thetrustedzone]

better to have custom bot for this , you could hire from hire freelancer section bot coder .

 

[RobertTheShark]

Either hire a freelancer or checkout which ecommerce system your target shops are using and search for bots that are developed for them.

 

[theRevolt]

Hi all!

I'm starting to build an ecommerce aggregator for a certain fashion niche. Therefore, I'm trying to find the best webscrapping tool/service over there.

I need to extract basic content such as: Product Name, Brand, Store, Price, Sale Price, Size, Color, Material and Product Image.

There are many services but I'd like to hear your opinion.

Thanks!

If you continuously need to scrape I just recommend python or better yet the framework already Scrapy

 

[rpkrocks]

Download Zennoposter and create yourself.

 

[bartosimpsonio]

+1 for Scrapy. You can get going from zero to bot in less than 2 hours.

 

[Badjoras]

If you continuously need to scrape I just recommend python or better yet the framework already Scrapy

Are there good tutorials for this? I have also read something about BeautifulSoup.

And thank you all for your replies!

 

[theRevolt]

Are there good tutorials for this? I have also read something about BeautifulSoup.

And thank you all for your replies!

Yes just Google bunch of tutorials. Kind of depends scraping & crawling in one go for Scrapy if just scraping from list of urls You can use beautiful soup

 

[Cyberars]

Zennoposter will be my choice, there is a learning curve but you will be able to create your own scraping bots very fast and later you will be able to update them yourself with no need to wait for 3rd parties support

 

[Chris.Roark]

Try Beagle Scraper, is an e-commerce scraper for Amazon that I developed while learning to code. Here's the tutorial https://www.bestproxyproviders.com/...pe-e-commerce-websites-and-modify-the-scraper

It extracts product information from a category page (name, price, rating, product page url) so you don't have to open and crawl all product pages. I developed it this way to use less resources and to scroll faster.

Bear in mind this is just a learning project, but you can use it as you want. The code is on github

 

[amoon]

imacros, zennoposter, ubot...or learn python and code your own bot from scratch ....

 

[Badjoras]

Try Beagle Scraper, is an e-commerce scraper for Amazon that I developed while learning to code. Here's the tutorial https://www.bestproxyproviders.com/...pe-e-commerce-websites-and-modify-the-scraper

It extracts product information from a category page (name, price, rating, product page url) so you don't have to open and crawl all product pages. I developed it this way to use less resources and to scroll faster.

Bear in mind this is just a learning project, but you can use it as you want. The code is on github

Does it work for regular webstores or only for Amazon?

 

[Badjoras]

Yes just Google bunch of tutorials. Kind of depends scraping & crawling in one go for Scrapy if just scraping from list of urls You can use beautiful soup

My goal is to create a website like Lyst or Stylight so probably the simplest option would be BeautifulSoup then. But I definitely need some time to learn how to work with Python...

 

[Chris.Roark]

Does it work for regular webstores or only for Amazon?

It extracts the css, so you can makenit work on any website.

Check the tutorial, it shows how to change the amazon css and create your own custom scraper

 

[chrishar]

Try Beagle Scraper, is an e-commerce scraper for Amazon that I developed while learning to code. Here's the tutorial https://www.bestproxyproviders.com/...pe-e-commerce-websites-and-modify-the-scraper

It extracts product information from a category page (name, price, rating, product page url) so you don't have to open and crawl all product pages. I developed it this way to use less resources and to scroll faster.

Bear in mind this is just a learning project, but you can use it as you want. The code is on github

thats a very good tool you did, thanks

 

[Alchemist-Programmer]

If you can create some python script it's a piece of cake. If you can't then I can help you doing that. Not a problem.