1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to rip posts from another WordPress website?

Discussion in 'Cloaking and Content Generators' started by theultimate1, Jun 29, 2013.

  1. theultimate1

    theultimate1 Registered Member

    Joined:
    Feb 17, 2010
    Messages:
    67
    Likes Received:
    5
    I want to rip the post titles and post contents of a WordPress blog. Is there a way to do this automatically for the entire site, instead of copy pasting one by one?

    I tried using RSS feeds in MS Excel, but that only shows the latest 10-15 posts of the website. I want to rip the entire website's content. The RSS feeds method is also alright, but it seems that RSS feeds, when newly subscribed to, will only give you content since after you've subscribed to the website's RSS feeds. Is there anyway to get the RSS feeds of a website since its existence?

    That's 2 questions, btw. :D
     
  2. innozemec

    innozemec Jr. VIP Jr. VIP

    Joined:
    Aug 19, 2011
    Messages:
    5,288
    Likes Received:
    1,799
    Location:
    www.Indexification.com
    Home Page:
    One way would be to Check if there's a sitemap, since in it all pages are listed, then simply find a way to crawl all pages and extract the content from them
     
    • Thanks Thanks x 1
  3. vladv

    vladv Junior Member

    Joined:
    Mar 23, 2013
    Messages:
    108
    Likes Received:
    10
    Thank 4 your quick reply,innozemec.
     
  4. theultimate1

    theultimate1 Registered Member

    Joined:
    Feb 17, 2010
    Messages:
    67
    Likes Received:
    5
    I thought of that too, but I'm currently clueless on how to go about that. Can you please share some thoughts? That'd be great. Thanks :)
     
  5. ContentLockPro

    ContentLockPro Power Member Premium Member

    Joined:
    Nov 7, 2012
    Messages:
    723
    Likes Received:
    129
    Basically what you are looking for is a auto blogging solution for a wordpress such as wprobot. Try to get yourself a latest version
     
  6. innozemec

    innozemec Jr. VIP Jr. VIP

    Joined:
    Aug 19, 2011
    Messages:
    5,288
    Likes Received:
    1,799
    Location:
    www.Indexification.com
    Home Page:
    well, i'd first check if there's some tool that can extract post content from provided list of pages. If no luck in finding such thing, i would code one in php in quick.. but thats just me since php is my specialty..
     
  7. theultimate1

    theultimate1 Registered Member

    Joined:
    Feb 17, 2010
    Messages:
    67
    Likes Received:
    5
    Isn't there a tool out there already that can extract stuff?
     
  8. verilix

    verilix Jr. VIP Jr. VIP

    Joined:
    Sep 18, 2009
    Messages:
    2,879
    Likes Received:
    1,277
    You can probably find someone on Freelancer.com to make a bot that will scrape their sitemap and post it on your Wordpress blog. I'd recommend weighing whether or not doing so is worth the price of a custom bot.
     
  9. innozemec

    innozemec Jr. VIP Jr. VIP

    Joined:
    Aug 19, 2011
    Messages:
    5,288
    Likes Received:
    1,799
    Location:
    www.Indexification.com
    Home Page:
    dunno, i haven't been searching.. try googling
     
  10. ekapek

    ekapek Jr. VIP Jr. VIP Premium Member

    Joined:
    Aug 2, 2010
    Messages:
    245
    Likes Received:
    41
    Home Page:
    If sitemap is not available you can use Xenu's Link Sleuth to get it and than any scraper
     
  11. alphadude

    alphadude Newbie

    Joined:
    Jul 4, 2013
    Messages:
    13
    Likes Received:
    2
    you can use wordpress rss aggregator and add the targeted websites feed and it will rip there posts and add it to your wordpress blog done this long time ago and it works;)
     
  12. damagro

    damagro Registered Member

    Joined:
    Mar 7, 2013
    Messages:
    88
    Likes Received:
    99
    He would like to scrape all posts of the website, not the latest x amount of the posts ;)
     
  13. montemaur

    montemaur Registered Member

    Joined:
    Jul 5, 2013
    Messages:
    61
    Likes Received:
    6
    I echo what the above poster said, you can get somebody on freelancer out of India or Pakistan who can crawl anything you want for dirt cheap, and they'll give you a built in function on the backend where all you have to do is hit a button that says "crawl new content" and it will automatically update for you. I've had it done before for a video site.
     
  14. MPhil7802

    MPhil7802 Newbie

    Joined:
    Jul 10, 2013
    Messages:
    6
    Likes Received:
    2
    Occupation:
    Webmaster & marketer
    I assume that you don't own the blog you're trying to copy content from because if you did all you have to do is export the data and import it elsewhere. I wonder if it's even possible to do what you're trying to accomplish because, for example, if I have WP installed on my server and I set the RSS to publish only the past 12 or 20 posts in the feed how can someone scrape the rest? I manage sites for a couple authors who turn their blog posts into books every year or so and we disable the posts after 4 weeks - switching to Draft status to prevent what you're trying to do. There's also a WP copyright plugin but that prevents right-click, printing and/or saving. Is the site you want to pull from on WordPress or a privately hosted account?
     
  15. nnsjw702

    nnsjw702 Registered Member

    Joined:
    Jan 3, 2010
    Messages:
    77
    Likes Received:
    1
    You can use wordpress RSS aggregator. Or you can hire a freelancer from asia to do this work. you can pay less for them also.
     
  16. kingoptimizer

    kingoptimizer Regular Member

    Joined:
    May 31, 2013
    Messages:
    273
    Likes Received:
    74
    I hope your landing pages cover all the updates that adwords bot covers OR you will get denied.

    Does anyone know of a tool that does that? I saw wpcloaker, but not sure if that works. Anybody tried this?!
     
  17. competent123

    competent123 Registered Member

    Joined:
    May 30, 2009
    Messages:
    55
    Likes Received:
    14
    the thing op trying to see is wordpress cloner.

    i've been looking for something like this for a long time as well, but havent' found that.

    i always get rss based solutions or
    expensive but better VA solutions , pay someone to copy paste content for 20-30$

    i have done hundreds of sites like this.

    almost clones it. with a bit of common sense.