Crawwl My Website Tool

Discussion in 'White Hat SEO' started by SammyGen, Jun 27, 2017.

  1. SammyGen

    SammyGen Newbie

    Joined:
    Jun 8, 2017
    Messages:
    45
    Likes Received:
    11
    Hi!
    Hoping you could point me in the direction of a tool that will crawl my website to get the meta data/content/response codes/etc.. I used Screaming Frog (unpaid) as a recommendation from an old thread, but it does not pull content. Can someone recommend one that does pull content as well? Preferably free, but I can pay for it as well.
     
  2. vilto

    vilto Regular Member

    Joined:
    Dec 4, 2016
    Messages:
    229
    Likes Received:
    38
    Gender:
    Male
    Screaming frog is used to crawl the links of a website, not its content.

    Could you be more precise and explain us what you want to do exactly ?