1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Google SERP scraping - Confused between using API and using scraped results

Discussion in 'General Programming Chat' started by PopUnder, Dec 25, 2014.

  1. PopUnder

    PopUnder Newbie

    Joined:
    Dec 19, 2012
    Messages:
    35
    Likes Received:
    5
    Home Page:
    I am working on a project for which I will need the organic search results from Google - I don't intend to directly scrape myself. Instead I could either use the API from sites like SEMRush, or there is an alternate provider who gives me the scraped results in HTML format. In terms of cost, using the scraped content makes a lot of sense. But since I am going to hire a developer, I do not want to take the scraping format if it means I have to constantly change the script (whenever Google changes the name of the div class, etc.)

    I was curious to know from others who have used scraped results if Google frequently changes the div classes of their search results? Or is this a bet I can safely take for now?
     
  2. MrBlue

    MrBlue Senior Member

    Joined:
    Dec 18, 2009
    Messages:
    974
    Likes Received:
    680
    Occupation:
    Web/Bot Developer
    This isn't something you should really worry about. Compared to other sites, Google isn't constantly changing their result layout. Many of my scraper scripts have been running without maintenance for quite some time.
     
    • Thanks Thanks x 1
  3. PopUnder

    PopUnder Newbie

    Joined:
    Dec 19, 2012
    Messages:
    35
    Likes Received:
    5
    Home Page:
    That's pretty reassuring. Thanks a lot for the note.