1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Using Node.js to scrape websites

Discussion in 'Black Hat SEO Tools' started by Baybo.it, Aug 10, 2011.

  1. Baybo.it

    Baybo.it Registered Member

    Joined:
    Aug 9, 2011
    Messages:
    72
    Likes Received:
    39
    Occupation:
    Founder of Baybo.it
    Location:
    San Francisco
    Home Page:
    Node js is a pretty cool new server-side tool that lets you run javascript on the server.

    We've been using it to scrape data from websites for a couple of months.

    Does anybody here ever use it?
     
  2. ~divinci

    ~divinci Registered Member

    Joined:
    Sep 23, 2009
    Messages:
    51
    Likes Received:
    11
    Occupation:
    Infastructure Reverse Engineer
    Location:
    Liverpool UK
    what do you do with the scraped data? does node.js have any database functionality?
     
  3. raj564

    raj564 Regular Member

    Joined:
    Dec 6, 2007
    Messages:
    317
    Likes Received:
    93
    Location:
    ive been looking at php's simple dom parser.

    but, i hear node.js and jquery make traversing the dom, pretty easy.
     
  4. n8g33k

    n8g33k Registered Member

    Joined:
    Dec 10, 2008
    Messages:
    60
    Likes Received:
    14