1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Making money with web scraping

Discussion in 'Associated Content & Writing Articles' started by deltamaster, Jul 20, 2014.

  1. deltamaster

    deltamaster Newbie

    Joined:
    Jun 25, 2014
    Messages:
    10
    Likes Received:
    0
    I'm interested in coding a real pro web scraping bot to grab content from a niche, transform it and automatically create sites with the transformed content.
    The intention is to automate everything, from getting the content to SEO.

    Obviously, I don't expect good content being generated. I'm just curious if some of you had experience with that and had good results.
     
  2. WPRipper

    WPRipper Supreme Member

    Joined:
    Mar 24, 2010
    Messages:
    1,379
    Likes Received:
    1,493
    Location:
    Proudly romanian
    Use ur skills to create something far more creative than this. Hope you got the message.
     
    • Thanks Thanks x 1
  3. deltamaster

    deltamaster Newbie

    Joined:
    Jun 25, 2014
    Messages:
    10
    Likes Received:
    0
    I like creative projects, but in major cases they don't generate any money hahaha.
    I'm always open to ideas if you can share them. Thx ;)
     
  4. meannn

    meannn Supreme Member

    Joined:
    Apr 22, 2009
    Messages:
    1,461
    Likes Received:
    1,896
    Occupation:
    Unemployed Winner
    Location:
    TR
    We were doing that 4 years ago. WPripper is correct. You're a bit late.
     
  5. LakeForest

    LakeForest Supreme Member

    Joined:
    Nov 11, 2009
    Messages:
    1,269
    Likes Received:
    1,802
    Location:
    Location Location
    Well, yeah it's been done, but it's still not as good as it could be. That market segment might be a little saturated, but if you believe you can create a better product, go ahead. We'd love to see it.

    What you should do is make a list of problems you have that other people probably do too and see if you can code a solution. Find a need and fill it. Listen to your users. Don't fix what isn't broken. You don't need to reinvent the wheel, just optimize it.
     
  6. deltamaster

    deltamaster Newbie

    Joined:
    Jun 25, 2014
    Messages:
    10
    Likes Received:
    0
    Which don't mean that I can't make money with it. Can you tell a little about your experience with the subject and the outcomes?

    I just want to know if the opportunity cost is good, but with these kind of laconic feedbacks, it's a little hard to define.
     
  7. deltamaster

    deltamaster Newbie

    Joined:
    Jun 25, 2014
    Messages:
    10
    Likes Received:
    0
    I don't intend to sell it, it's for personal use only. Since it's a time consuming activity, I was interested in knowing people that make money that way so I can get some feedback.
     
  8. LakeForest

    LakeForest Supreme Member

    Joined:
    Nov 11, 2009
    Messages:
    1,269
    Likes Received:
    1,802
    Location:
    Location Location
    I think the Scrapebox and GScraper teams are happy.

    Hope your product works out better for you than if you would just buy their's or hire another programmer, time is money after all, and scrape bots of all purpose are becoming a dime a dozen, except for Scrapebox and GScraper(Though I've been hearing conflicting reviews of GScraper recently).
     
  9. deltamaster

    deltamaster Newbie

    Joined:
    Jun 25, 2014
    Messages:
    10
    Likes Received:
    0
    It's not just scraping. I would get the content, transform it accordingly (to generate unique content) and insert it in a wordpress instance (or use some static content generator to generate static pages)

    Besides that, it would not be a desktop app, since it's not very scalable.

    Chris Reeves did something similar, getting the content and inserting in a wordpress instance, and produced some videos if you are interested. Look for the "Python Web Scraping Tutorial" in youtube
     
    Last edited: Jul 20, 2014
  10. lord1027

    lord1027 Elite Member

    Joined:
    Sep 20, 2013
    Messages:
    3,174
    Likes Received:
    2,222
    For content, I recommend WP Robot. For everything, I have no idea.
     
    • Thanks Thanks x 1