1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Web Scraping: Detecting Changes

Discussion in 'General Scripting Chat' started by Domo_18895, Aug 19, 2013.

  1. Domo_18895

    Domo_18895 Newbie

    Joined:
    Jan 29, 2013
    Messages:
    34
    Likes Received:
    11
    Does anyone have any tips for detecting significant script breaking changes in a page?
     
  2. divok

    divok Senior Member

    Joined:
    Jul 21, 2010
    Messages:
    1,015
    Likes Received:
    634
    Location:
    http://twitter.com/divok
    As caravel stated use try and catch blocks , I get to mail myself if the script breaks .
    http://docs.python.org/2/library/email-examples.htm
    I send myself a mail , whenever the scripts break . Since i have a few scrapers I also tell myself which script has broken
     
    • Thanks Thanks x 1