How to Scrape using NodeJS and JQuery: (Get your IP, Host and User-Agent)

[dreadpixel]

Here is a chunk of code that will go to a get my ip domain and extract using CSS selectors thanks to JQuery library for NodeJS called Cheerio.
The code is properly explained on comments:

var request = require('request'); // we need request library
var cheerio = require('cheerio'); // and cheerio library/ JQuery
// set some defaults
req = request.defaults({
  jar: true,                 // save cookies to jar
  rejectUnauthorized: false,
  followAllRedirects: true   // allow redirections
});
// scrape the page
req.get({
    url: "http://www.whatsmyip.org/",
    headers: {
        'User-Agent': 'Google' // You can put the user-agent that you want
     }
  }, function(err, resp, body) {
 
  // load the html into cheerio
  var $ = cheerio.load(body);
 
  // get the data and output to console
  console.log( 'IP: ' + $('#ip').text() );  //scrape using CSS selector
  console.log( 'Host: ' + $('#hostname').text() );
  console.log( 'User-Agent: ' + $('#useragent').text() );
});

 

[Mr.Charles]

Great contribution. Cheerio is a very powerful library, Just now I'm doing tests with it.

 

[dreadpixel]

Great contribution. Cheerio is a very powerful library, Just now I'm doing tests with it.

Im glad this worked for you, getting CSS selectors this easy is very cool instead of using xpath.