meta crawler?

Discussion in 'White Hat SEO' started by Lebron2727, Mar 11, 2012.

Tags:
  1. Lebron2727

    Lebron2727 Junior Member

    Joined:
    Nov 28, 2011
    Messages:
    179
    Likes Received:
    41
    Ok so I am doing some SEO work for a company, and there are a lot of pages that do not have meta discriptions... Their website has 1000s of pages that should all be indexed, is there a tool that can check every page and just asks this question:

    Does this page have a metatitle? If no, red flag.

    So I can have a list of all pages that do not have them, would be very cool and save lots and lots of time.
     
  2. St0n3y

    St0n3y Newbie

    Joined:
    Aug 29, 2009
    Messages:
    14
    Likes Received:
    2
    Yes there is a tool just open a shell and use grep.
     
  3. AlexXXL

    AlexXXL Newbie

    Joined:
    Feb 23, 2012
    Messages:
    15
    Likes Received:
    7
    +1 for grep
    but
    Code:
    wget -r
    to download whole site first.