Using Node.js to scrape websites

Discussion in 'Black Hat SEO Tools' started by Baybo.it, Aug 10, 2011.

  1. Baybo.it

    Baybo.it Registered Member

    Joined:
    Aug 9, 2011
    Messages:
    72
    Likes Received:
    39
    Occupation:
    Founder of Baybo.it
    Location:
    San Francisco
    Node js is a pretty cool new server-side tool that lets you run javascript on the server.

    We've been using it to scrape data from websites for a couple of months.

    Does anybody here ever use it?
     
  2. ~divinci

    ~divinci Registered Member

    Joined:
    Sep 23, 2009
    Messages:
    51
    Likes Received:
    11
    Occupation:
    Infastructure Reverse Engineer
    Location:
    Liverpool UK
    what do you do with the scraped data? does node.js have any database functionality?
     
  3. raj564

    raj564 Regular Member

    Joined:
    Dec 6, 2007
    Messages:
    317
    Likes Received:
    93
    Location:
    ive been looking at php's simple dom parser.

    but, i hear node.js and jquery make traversing the dom, pretty easy.
     
  4. n8g33k

    n8g33k Registered Member

    Joined:
    Dec 10, 2008
    Messages:
    60
    Likes Received:
    14