1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Need something to scrape entire wordpress sites

Discussion in 'Black Hat SEO Tools' started by llewopsnimajneb, Apr 18, 2013.

  1. llewopsnimajneb

    llewopsnimajneb Regular Member

    Joined:
    Jan 10, 2011
    Messages:
    242
    Likes Received:
    139
    Occupation:
    SEO, Affiliate marketer, Online marketing lecturer
    Location:
    Backwardstown
    Hey guys,

    I had a business arrangement with some people and it went sour, so I lost my access to some supporting websites that I use for other projects. I am trying to find a way to scrape the sites and save them as I believe that the guys I went into business with, may stuff it all up and lose the sites.

    I want to be able to put them back up on my own servers should I need to, but as I no longer have back end access to copy the sites and database, I need to find another way.

    Any help?
     
  2. divok

    divok Senior Member

    Joined:
    Jul 21, 2010
    Messages:
    1,015
    Likes Received:
    634
    Location:
    http://twitter.com/divok
    if you are trying to scrape the wp posts than there is a scrapy project available which can scrape all the posts on a wordpress installation , try googling for that.
     
  3. prospect7

    prospect7 Regular Member

    Joined:
    Feb 24, 2010
    Messages:
    273
    Likes Received:
    192
    pay someone to scrape it for you

    there are programs but it's easier just to outsource
     
  4. RedLable

    RedLable Regular Member

    Joined:
    Feb 16, 2011
    Messages:
    244
    Likes Received:
    32
    BlackWidow - a site ripper
    HTTrack - download a full website hole
     
  5. blackhat777

    blackhat777 Elite Member

    Joined:
    Jun 25, 2011
    Messages:
    1,779
    Likes Received:
    653
    If you want to scrape just the posts and images, then I can do that.
     
  6. InternetMayhem

    InternetMayhem Regular Member

    Joined:
    Dec 30, 2011
    Messages:
    236
    Likes Received:
    22
    Location:
    California
    I would say HTTrack, I know of no fully automated solution.
     
  7. Kixstart

    Kixstart Junior Member

    Joined:
    Apr 15, 2013
    Messages:
    161
    Likes Received:
    62
    Location:
    Old Europe
    With the scrapers above, can you also scrape the entire template along with widgets, etc?
     
  8. affiliatepros

    affiliatepros Junior Member

    Joined:
    Jan 2, 2010
    Messages:
    113
    Likes Received:
    15
    I would suggest to find a programmer on elance, who can write a script that will do this for you.. The other option might be to try yourself with tools like UBot. Or maybe thats an ideal chance to learn programming :)
     
    • Thanks Thanks x 1
  9. nopme88

    nopme88 Registered Member

    Joined:
    Jul 30, 2013
    Messages:
    50
    Likes Received:
    7
    Occupation:
    Freelancer
    There is a scraper plugin for wp
     
  10. massguru

    massguru Senior Member

    Joined:
    Mar 23, 2009
    Messages:
    1,119
    Likes Received:
    218
    Occupation:
    Internet Marketing
    Location:
    India
    Home Page:
    I can do this for you, if you still need it.

    Thanks and Regards
     
  11. arganrecords

    arganrecords Elite Member

    Joined:
    Oct 12, 2013
    Messages:
    1,611
    Likes Received:
    1,904
    Occupation:
    I think I'm Marketer
    Location:
    Italy
    You need Scrapebox, really useful and easy to do this task (few seconds)
     
  12. xha44a

    xha44a Power Member

    Joined:
    Dec 2, 2012
    Messages:
    532
    Likes Received:
    444
    There is no need to pay someone or get someone to write you a script. Lookup wget for windows and learn (10 minutes if you have any computer saavy) how to use it and run with it. I used it to download 15k Yahoo voices article I'm pretty sure it can handle a wordpress site...

    XH
     
  13. Tom Baker

    Tom Baker Registered Member

    Joined:
    Jun 25, 2014
    Messages:
    97
    Likes Received:
    52
    Old school Teleport Pro :)
     
  14. Anytimesoftcare

    Anytimesoftcare Senior Member

    Joined:
    Jul 29, 2014
    Messages:
    804
    Likes Received:
    1
    Occupation:
    Software, website, Mobile Application Development
    Location:
    its Virtual
    Home Page:
    Please add us on Skype: Anytimesoftcare, we can scrape websites, we have an lots of experience in this.