Amazon Scraper - coming up!!

Hello fellow BHWs,

My first post here, but definitely not a novice as far as knowledge on Amazon goes
Hence have decided to come up with a tool to scrape Amazon. While I have been checking for availability of such tools, I find that the current tools in the market have certain limitations as below:

1. Some tools, browser based as well as independent windows applications don't scrape anything else other than the ASIN
2. Some tools need the user to navigate to the next page of the search result to fire any onwards scraping
3. Some good ones are dead (OPF)
4. Some use Amazon AWS which is very limited
5. Some web based or URL based tools are very slow

The only tool I found which is close to what I wanted to build is ZonAsinHunter. But this is a bit pricy.

My thoughts are:

I will provide a tool that can take an URL or allow the user to select on categories. The landing page items and then paging through 400 pages will be fast. The tool will also have the option of scanning more than 400 pages of data. Details scanning will also be an option - (where you open the details of the item and get all relevant attributes including reviews)

I am looking for some suggestions that I need to include as features in this tool that will make it more appealing to the mass. In return I am willing to share a full working version of the tool once it is ready to each one of you who can suggest me a feature list (right now, its design and basic framework is completed).

I know there is no guarantee that once you provide the list and I implement the tool, whether I would send you a version or not. And you are right - I wont be able to convince you too that I would really share. Its really up to you and trusting my post.

Looking forward to your response.

what exactly do you need mate?

I'm guessing this is FREE? since you cannot sell here without paying!

-Sasha

I recently made a tool you are describing above and i m not sure if you checked amazon, but if you did, then i wish you a good luck in coding this and giving it for free, you are insane.

I wont sale my for 100$ (sold one for 75)
Why so much?
Amazon dont like scrapers, they use encoded images at some parts, they have all kind of pages and various page types. So it is not a thing where u go there and just scrape it.

You will need to write lots of code. I spend several days on coding it, and several days on testing it and everytime i run a test i found out a bug. So i wish you good luck once again. hehe

These are some of the features I would like to see.
The ability to:
Select a catagory to scrape, where you use certain criteria, such as $ upper and lower limits
Select if it should have a specific number of reviews.
Select the minimum review rating.
Ensure the item has the "In Stock." value in the text
Save the larger image, as the ASIN. (There shouls also be the option to save the image url)
The ability to capture your affiliate code somewhere, so that once the crape happens, you end up with a spreadsheed that has the following columns-
- Image reference (Yes I know it will be the ASIN, but if the user selected to save the url reference then this is placed in this column)
- The user should be presented with a list of shortneing services, or you could provide a link cloacker yourself.
- Product title
- Product description
- Price
- List price
- Star rating
- Your affiliate link.
- The link shortned affiliate linked cloacked service.
- script to paste all of the above in a format that you can simply copy and paste into a site.

It would be good to have the ability to autopost the script to a selected list of web 2.0 sites, but there would need to be a lot of work done to accomplish this.

This sounds great. I've been doing things you listed above manually and it can be very time consuming. If you could automate these in a single tool that would be awesome, good luck with that!

Most of the things can be done with ZonAsinHunter and it`s only $37. I`m pretty sure that it`s not worth to code another scraper.

Cheers

andreint said:

what exactly do you need mate?

Click to expand...

Am looking for some features that people who use Amazon to make money would be interested in seeing in an Amazon Scraper.

sashablack said:

I'm guessing this is FREE? since you cannot sell here without paying!

-Sasha

Click to expand...

Yes, it would be free for people who would be suggesting features they want to see in the tool.

saadad said:

I recently made a tool you are describing above and i m not sure if you checked amazon, but if you did, then i wish you a good luck in coding this and giving it for free, you are insane.

I wont sale my for 100$ (sold one for 75)
Why so much?
Amazon dont like scrapers, they use encoded images at some parts, they have all kind of pages and various page types. So it is not a thing where u go there and just scrape it.

You will need to write lots of code. I spend several days on coding it, and several days on testing it and everytime i run a test i found out a bug. So i wish you good luck once again. hehe

Click to expand...

All valid points. Yes Amazon does have multiple formats that makes scraping tough. Have had some experience in creating bots which I propose to use. Yes I need to write lots of code but thankfully, lot of that is already written. Thanks for your wishes.

Thanks dbands. Will see how many of them I can complete. As promised whenever the tool is ready I will contact you at this thread to for a free copy.

peetrike said:

Most of the things can be done with ZonAsinHunter and it`s only $37. I`m pretty sure that it`s not worth to code another scraper.

Cheers

Click to expand...

Yes it would be - if it has different or added functions.

K.

I need the tool which can fetch any Amazon seller's all ASIN.
If anyone knows thisi kind of tool or can make it, I can pay to him.
thank you.