1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to get list of all articles from wikihow?

Discussion in 'Black Hat SEO' started by Artemis Fowl, Jun 13, 2017.

  1. Artemis Fowl

    Artemis Fowl Registered Member

    Joined:
    Apr 2, 2013
    Messages:
    74
    Likes Received:
    6
    Hi, I would like to get list off all urls (all articles) from wikihow. Not from wikihow.com but from another language mutation.

    Simply said is it possible to export all urls from wikihow to an excel or txt file?
     
  2. javabro

    javabro Power Member

    Joined:
    Dec 2, 2015
    Messages:
    630
    Likes Received:
    670
    Gender:
    Male
  3. Artemis Fowl

    Artemis Fowl Registered Member

    Joined:
    Apr 2, 2013
    Messages:
    74
    Likes Received:
    6
  4. Ettienne

    Ettienne Jr. VIP Jr. VIP

    Joined:
    Mar 3, 2017
    Messages:
    147
    Likes Received:
    22
    Gender:
    Male
    Home Page:
    There are numerous article scrapers available online, but getting ALL their articles will take forever and take a ton of space. Just do a search here for "Article scraper", or try Google if you can't find anything on the forum
     
    • Thanks Thanks x 1
  5. W9go

    W9go Jr. VIP Jr. VIP Premium Member

    Joined:
    May 16, 2011
    Messages:
    4,622
    Likes Received:
    930
    Gender:
    Male
    Occupation:
    chasing girls
    Location:
    chasing girls
    never tried but scrape box will do.
     
  6. akssiv2007

    akssiv2007 Senior Member

    Joined:
    Jul 11, 2013
    Messages:
    897
    Likes Received:
    198
    Gender:
    Male
    Occupation:
    Webber
    Location:
    Earth
    I suppose all these articles should be indexed in Google so you can export the url's to CSV using moz chrome extension.

    But it will be time taking too many pages.:mad:
     
    • Thanks Thanks x 1
  7. tigerwood

    tigerwood Newbie

    Joined:
    Sep 1, 2013
    Messages:
    21
    Likes Received:
    2
    use article scraper :
    Octoparse
    WebHarvy
    ScrapeBox
     
    • Thanks Thanks x 1
  8. bartosimpsonio

    bartosimpsonio Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 21, 2013
    Messages:
    12,027
    Likes Received:
    10,817
    Occupation:
    WHEREZ MA
    Location:
    BITCOINS AT?
    Home Page:
    You can mirror wikihow with the free tool wget

    Code:
    wget --mirror -U "user agent string here" http://LANGUAGE.wikihow.com/
    It's around 500k articles, so you probably need a fast VPS for this.
     
  9. ThopHayt

    ThopHayt Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 25, 2011
    Messages:
    6,352
    Likes Received:
    2,291
    Scrape it. Scrapebox. If you can't scrape it yourself post in the hire a freelancer section and pay somebody.

    -ThopHayt
     
    • Thanks Thanks x 1
  10. djp371

    djp371 Elite Member

    Joined:
    Apr 20, 2009
    Messages:
    1,968
    Likes Received:
    342
    Occupation:
    Internet marketing
    Location:
    United States
    Home Page:
    I recommend you use ScrapeBox.