1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

meta crawler?

Discussion in 'White Hat SEO' started by Lebron2727, Mar 11, 2012.

Tags:
  1. Lebron2727

    Lebron2727 Junior Member

    Joined:
    Nov 28, 2011
    Messages:
    179
    Likes Received:
    41
    Ok so I am doing some SEO work for a company, and there are a lot of pages that do not have meta discriptions... Their website has 1000s of pages that should all be indexed, is there a tool that can check every page and just asks this question:

    Does this page have a metatitle? If no, red flag.

    So I can have a list of all pages that do not have them, would be very cool and save lots and lots of time.
     
  2. St0n3y

    St0n3y Newbie

    Joined:
    Aug 29, 2009
    Messages:
    14
    Likes Received:
    2
    Yes there is a tool just open a shell and use grep.
     
  3. AlexXXL

    AlexXXL Newbie

    Joined:
    Feb 23, 2012
    Messages:
    15
    Likes Received:
    7
    Home Page:
    +1 for grep
    but
    Code:
    wget -r
    to download whole site first.