1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to get list of all articles from wikihow?

Discussion in 'Black Hat SEO' started by Artemis Fowl, Jun 13, 2017.

  1. Artemis Fowl

    Artemis Fowl Registered Member

    Joined:
    Apr 2, 2013
    Messages:
    74
    Likes Received:
    6
    Hi, I would like to get list off all urls (all articles) from wikihow. Not from wikihow.com but from another language mutation.

    Simply said is it possible to export all urls from wikihow to an excel or txt file?
     
  2. javabro

    javabro Power Member

    Joined:
    Dec 2, 2015
    Messages:
    632
    Likes Received:
    674
    Gender:
    Male
  3. Artemis Fowl

    Artemis Fowl Registered Member

    Joined:
    Apr 2, 2013
    Messages:
    74
    Likes Received:
    6
  4. Ettienne

    Ettienne Jr. VIP Jr. VIP

    Joined:
    Mar 3, 2017
    Messages:
    147
    Likes Received:
    22
    Gender:
    Male
    Home Page:
    There are numerous article scrapers available online, but getting ALL their articles will take forever and take a ton of space. Just do a search here for "Article scraper", or try Google if you can't find anything on the forum
     
    • Thanks Thanks x 1
  5. W9go

    W9go Jr. VIP Jr. VIP Premium Member

    Joined:
    May 16, 2011
    Messages:
    4,891
    Likes Received:
    1,004
    Gender:
    Male
    Occupation:
    chasing girls
    Location:
    chasing girls
    never tried but scrape box will do.
     
  6. akssiv2007

    akssiv2007 Senior Member

    Joined:
    Jul 11, 2013
    Messages:
    960
    Likes Received:
    220
    Gender:
    Male
    Occupation:
    Webber
    Location:
    Earth
    I suppose all these articles should be indexed in Google so you can export the url's to CSV using moz chrome extension.

    But it will be time taking too many pages.:mad:
     
    • Thanks Thanks x 1
  7. tigerwood

    tigerwood Newbie

    Joined:
    Sep 1, 2013
    Messages:
    21
    Likes Received:
    2
    use article scraper :
    Octoparse
    WebHarvy
    ScrapeBox
     
    • Thanks Thanks x 1
  8. bartosimpsonio

    bartosimpsonio Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 21, 2013
    Messages:
    12,493
    Likes Received:
    11,191
    Occupation:
    CHEAP
    Location:
    DATASETS
    Home Page:
    You can mirror wikihow with the free tool wget

    Code:
    wget --mirror -U "user agent string here" http://LANGUAGE.wikihow.com/
    It's around 500k articles, so you probably need a fast VPS for this.
     
  9. ThopHayt

    ThopHayt Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 25, 2011
    Messages:
    6,687
    Likes Received:
    2,525
    Scrape it. Scrapebox. If you can't scrape it yourself post in the hire a freelancer section and pay somebody.

    -ThopHayt
     
    • Thanks Thanks x 1
  10. djp371

    djp371 Elite Member

    Joined:
    Apr 20, 2009
    Messages:
    2,074
    Likes Received:
    349
    Occupation:
    Internet marketing
    Location:
    United States
    Home Page:
    I recommend you use ScrapeBox.