Kilnarix
Newbie
- Dec 2, 2023
- 21
- 16
I built a web scraper for a client. It runs daily and generates lists of American businesses. I am capturing the location, business type, name, address, phone number and URL (if they have one). The scraper can generate 200,000 records a day if needed and I have built up a database of millions of records.
I also wrote a google maps scraper for him but he decided not to use it but it is sitting there ready to run.
I use rotating proxies, the bots all run on a server I control, the data is backed up and encrypted. Everything runs smoothly. I am good at scraping data at scale, in parallel using proxies to avoid getting blocked.
There is nothing stopping me reselling this data to someone else, and/or adapting the existing bots to better serve a new client. What do you guys think? What is this data worth? My client pays me around $400 a month.
I also wrote a google maps scraper for him but he decided not to use it but it is sitting there ready to run.
I use rotating proxies, the bots all run on a server I control, the data is backed up and encrypted. Everything runs smoothly. I am good at scraping data at scale, in parallel using proxies to avoid getting blocked.
There is nothing stopping me reselling this data to someone else, and/or adapting the existing bots to better serve a new client. What do you guys think? What is this data worth? My client pays me around $400 a month.
