Recent content by smoney

Really just looking for advice/experience/recommendations on software and approaches to scrape such large sites. I can handle all of the technical aspects myself. I know php/mysql and javascript, familiar with python and ROR, but don't want to spend time coding if possible. This project will...

I need to build a database of sellers on Alibaba and Tradekey, possibly including photos of their products but I'm more interested in consolidating and categorizing their contact information. Has anyone here tried scraping the site, do they block bots, and can anyone recommend a good tool? Once...