Making money with web scraping

[deltamaster]

I'm interested in coding a real pro web scraping bot to grab content from a niche, transform it and automatically create sites with the transformed content.
The intention is to automate everything, from getting the content to SEO.

Obviously, I don't expect good content being generated. I'm just curious if some of you had experience with that and had good results.

 

[WPRipper]

Use ur skills to create something far more creative than this. Hope you got the message.

 

[deltamaster]

Use ur skills to create something far more creative than this. Hope you got the message.

I like creative projects, but in major cases they don't generate any money hahaha.
I'm always open to ideas if you can share them. Thx

 

[meannn]

We were doing that 4 years ago. WPripper is correct. You're a bit late.

 

[LakeForest]

Well, yeah it's been done, but it's still not as good as it could be. That market segment might be a little saturated, but if you believe you can create a better product, go ahead. We'd love to see it.

What you should do is make a list of problems you have that other people probably do too and see if you can code a solution. Find a need and fill it. Listen to your users. Don't fix what isn't broken. You don't need to reinvent the wheel, just optimize it.

 

[deltamaster]

We were doing that 4 years ago. WPripper is correct. You're a bit late.

Which don't mean that I can't make money with it. Can you tell a little about your experience with the subject and the outcomes?

I just want to know if the opportunity cost is good, but with these kind of laconic feedbacks, it's a little hard to define.

 

[deltamaster]

Well, yeah it's been done, but it's still not as good as it could be. That market segment might be a little saturated, but if you believe you can create a better product, go ahead. We'd love to see it.

What you should do is make a list of problems you have that other people probably do too and see if you can code a solution. Find a need and fill it. Listen to your users. Don't fix what isn't broken. You don't need to reinvent the wheel, just optimize it.

I don't intend to sell it, it's for personal use only. Since it's a time consuming activity, I was interested in knowing people that make money that way so I can get some feedback.

 

[LakeForest]

I don't intend to sell it, it's for personal use only. Since it's a time consuming activity, I was interested in knowing people that make money that way so I can get some feedback.

I think the Scrapebox and GScraper teams are happy.

Hope your product works out better for you than if you would just buy their's or hire another programmer, time is money after all, and scrape bots of all purpose are becoming a dime a dozen, except for Scrapebox and GScraper(Though I've been hearing conflicting reviews of GScraper recently).

 

[deltamaster]

I think the Scrapebox and GScraper teams are happy.

Hope your product works out better for you than if you would just buy their's or hire another programmer, time is money after all, and scrape bots of all purpose are becoming a dime a dozen, except for Scrapebox and GScraper(Though I've been hearing conflicting reviews of GScraper recently).

It's not just scraping. I would get the content, transform it accordingly (to generate unique content) and insert it in a wordpress instance (or use some static content generator to generate static pages)

Besides that, it would not be a desktop app, since it's not very scalable.

Chris Reeves did something similar, getting the content and inserting in a wordpress instance, and produced some videos if you are interested. Look for the "Python Web Scraping Tutorial" in youtube

 

[lord1027]

I don't intend to sell it, it's for personal use only. Since it's a time consuming activity, I was interested in knowing people that make money that way so I can get some feedback.

For content, I recommend WP Robot. For everything, I have no idea.