Need something to scrape entire wordpress sites

Discussion in 'Black Hat SEO Tools' started by llewopsnimajneb, Apr 18, 2013.

  1. llewopsnimajneb

    llewopsnimajneb Regular Member

    Joined:
    Jan 10, 2011
    Messages:
    242
    Likes Received:
    139
    Occupation:
    SEO, Affiliate marketer, Online marketing lecturer
    Location:
    Backwardstown
    Hey guys,

    I had a business arrangement with some people and it went sour, so I lost my access to some supporting websites that I use for other projects. I am trying to find a way to scrape the sites and save them as I believe that the guys I went into business with, may stuff it all up and lose the sites.

    I want to be able to put them back up on my own servers should I need to, but as I no longer have back end access to copy the sites and database, I need to find another way.

    Any help?
     
  2. divok

    divok Senior Member

    Joined:
    Jul 21, 2010
    Messages:
    1,068
    Likes Received:
    648
    Location:
    .IN
    if you are trying to scrape the wp posts than there is a scrapy project available which can scrape all the posts on a wordpress installation , try googling for that.
     
  3. prospect7

    prospect7 Regular Member

    Joined:
    Feb 24, 2010
    Messages:
    273
    Likes Received:
    195
    pay someone to scrape it for you

    there are programs but it's easier just to outsource
     
  4. RedLable

    RedLable Regular Member

    Joined:
    Feb 16, 2011
    Messages:
    244
    Likes Received:
    32
    BlackWidow - a site ripper
    HTTrack - download a full website hole
     
  5. blackhat777

    blackhat777 Elite Member

    Joined:
    Jun 25, 2011
    Messages:
    1,784
    Likes Received:
    653
    If you want to scrape just the posts and images, then I can do that.
     
  6. InternetMayhem

    InternetMayhem Regular Member

    Joined:
    Dec 30, 2011
    Messages:
    238
    Likes Received:
    22
    Location:
    California
    I would say HTTrack, I know of no fully automated solution.
     
  7. Kixstart

    Kixstart Junior Member

    Joined:
    Apr 15, 2013
    Messages:
    181
    Likes Received:
    72
    Location:
    Old Europe
    With the scrapers above, can you also scrape the entire template along with widgets, etc?
     
  8. affiliatepros

    affiliatepros Junior Member

    Joined:
    Jan 2, 2010
    Messages:
    112
    Likes Received:
    15
    I would suggest to find a programmer on elance, who can write a script that will do this for you.. The other option might be to try yourself with tools like UBot. Or maybe thats an ideal chance to learn programming :)
     
    • Thanks Thanks x 1
  9. nopme88

    nopme88 Registered Member

    Joined:
    Jul 30, 2013
    Messages:
    50
    Likes Received:
    7
    Occupation:
    Freelancer
    There is a scraper plugin for wp
     
  10. massguru

    massguru Senior Member

    Joined:
    Mar 23, 2009
    Messages:
    1,122
    Likes Received:
    219
    Occupation:
    Internet Marketing
    Location:
    India
    Home Page:
    I can do this for you, if you still need it.

    Thanks and Regards
     
  11. arganrecords

    arganrecords Elite Member

    Joined:
    Oct 12, 2013
    Messages:
    1,672
    Likes Received:
    2,074
    Occupation:
    Go Hard Or Go Home
    Location:
    Italy
    You need Scrapebox, really useful and easy to do this task (few seconds)
     
  12. xha44a

    xha44a Power Member

    Joined:
    Dec 2, 2012
    Messages:
    532
    Likes Received:
    453
    There is no need to pay someone or get someone to write you a script. Lookup wget for windows and learn (10 minutes if you have any computer saavy) how to use it and run with it. I used it to download 15k Yahoo voices article I'm pretty sure it can handle a wordpress site...

    XH
     
  13. Tom Baker

    Tom Baker Junior Member

    Joined:
    Jun 25, 2014
    Messages:
    109
    Likes Received:
    63
    Old school Teleport Pro :)
     
  14. Anytimesoftcare

    Anytimesoftcare Senior Member

    Joined:
    Jul 29, 2014
    Messages:
    804
    Likes Received:
    1
    Occupation:
    Software, website, Mobile Application Development
    Location:
    its Virtual
    Please add us on Skype: Anytimesoftcare, we can scrape websites, we have an lots of experience in this.