1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scrape wikihow

Discussion in 'Hire a Freelancer' started by RMCollab, Mar 19, 2015.

  1. RMCollab

    RMCollab Newbie

    Joined:
    Mar 18, 2015
    Messages:
    15
    Likes Received:
    0
    Hi,

    I am looking to hire someone to scrape wikihow
    I am newbie to this and need some assistants.


    Thank you!
     
  2. ShahidMian

    ShahidMian Junior Member

    Joined:
    May 14, 2014
    Messages:
    114
    Likes Received:
    12
    Gender:
    Male
    you want to scrape whole content from wikihow?
     
  3. YourMoneyButton

    YourMoneyButton Senior Member

    Joined:
    Dec 1, 2013
    Messages:
    971
    Likes Received:
    211
    Location:
    Automating The Web
    What specific content are you looking to scrape?
     
  4. Rising

    Rising Junior Member

    Joined:
    Dec 14, 2014
    Messages:
    162
    Likes Received:
    3
    Occupation:
    Software Developer
    Location:
    EH
    Home Page:
    What do you actually need from that site ? Skype me with complete details
     
  5. RMCollab

    RMCollab Newbie

    Joined:
    Mar 18, 2015
    Messages:
    15
    Likes Received:
    0
    Yes. All the how to's on that site. Thanks
     
  6. RMCollab

    RMCollab Newbie

    Joined:
    Mar 18, 2015
    Messages:
    15
    Likes Received:
    0
    All the how-to's on the site. Thanks!
     
  7. YourMoneyButton

    YourMoneyButton Senior Member

    Joined:
    Dec 1, 2013
    Messages:
    971
    Likes Received:
    211
    Location:
    Automating The Web
    You're aware that there's almost 200,000 how-to articles as of today correct?!
     
  8. Nut-Nights

    Nut-Nights Jr. VIP Jr. VIP

    Joined:
    Jun 20, 2013
    Messages:
    5,604
    Likes Received:
    3,517
    Location:
    Hell
    Home Page:
    You can scrape them, just need a bot and vps.
     
  9. bluestar003

    bluestar003 Registered Member

    Joined:
    May 7, 2014
    Messages:
    63
    Likes Received:
    20
    creating a bot to scrap everything from the wiki how is easy with python and scrapy but you need good resource to process and store the data
     
  10. YourMoneyButton

    YourMoneyButton Senior Member

    Joined:
    Dec 1, 2013
    Messages:
    971
    Likes Received:
    211
    Location:
    Automating The Web
    But where are you going to store all the data on a VPS? Not many offer multiple TB of storage space.
     
  11. RMCollab

    RMCollab Newbie

    Joined:
    Mar 18, 2015
    Messages:
    15
    Likes Received:
    0
    Hi, i sent you a request on skype.
     
  12. ralphnsk

    ralphnsk Newbie

    Joined:
    Nov 2, 2009
    Messages:
    43
    Likes Received:
    13
    Gender:
    Male
    Location:
    /dev/random
    I have downloaded a sample post for you, pls see if this is what you need (PM sent)
     
  13. RMCollab

    RMCollab Newbie

    Joined:
    Mar 18, 2015
    Messages:
    15
    Likes Received:
    0
    Hi,

    i am unable to send a PM, what is your skype so i can talk to you there. Thank you!
     
  14. ralphnsk

    ralphnsk Newbie

    Joined:
    Nov 2, 2009
    Messages:
    43
    Likes Received:
    13
    Gender:
    Male
    Location:
    /dev/random
    Just click the blue skype icon under my profile.
     
  15. RMCollab

    RMCollab Newbie

    Joined:
    Mar 18, 2015
    Messages:
    15
    Likes Received:
    0
    Hi, I sent you a request through Skype. please respond.
     
  16. American Trends

    American Trends Jr. VIP Jr. VIP

    Joined:
    Mar 14, 2014
    Messages:
    794
    Likes Received:
    120
    Occupation:
    White Hat SEO Company
    Location:
    American Trends
    Try rankwyz article scraper. That will scrape nearly all indexed how to articles.
     
  17. qrazy

    qrazy Senior Member

    Joined:
    Mar 19, 2012
    Messages:
    1,115
    Likes Received:
    1,725
    Location:
    Banana Republic
    It won't even be in GBs let along TBs..
     
  18. YourMoneyButton

    YourMoneyButton Senior Member

    Joined:
    Dec 1, 2013
    Messages:
    971
    Likes Received:
    211
    Location:
    Automating The Web
    200,000 articles?

    Some of them are 25mb+ including the images
     
  19. RMCollab

    RMCollab Newbie

    Joined:
    Mar 18, 2015
    Messages:
    15
    Likes Received:
    0
    Hi sent you a skype. Please respond
     
  20. RMCollab

    RMCollab Newbie

    Joined:
    Mar 18, 2015
    Messages:
    15
    Likes Received:
    0

    Hi i sent you a skype. Please respond