1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Crawwl My Website Tool

Discussion in 'White Hat SEO' started by SammyGen, Jun 27, 2017.

  1. SammyGen

    SammyGen Newbie

    Joined:
    Jun 8, 2017
    Messages:
    45
    Likes Received:
    11
    Hi!
    Hoping you could point me in the direction of a tool that will crawl my website to get the meta data/content/response codes/etc.. I used Screaming Frog (unpaid) as a recommendation from an old thread, but it does not pull content. Can someone recommend one that does pull content as well? Preferably free, but I can pay for it as well.
     
  2. vilto

    vilto Jr. VIP Jr. VIP

    Joined:
    Dec 4, 2016
    Messages:
    230
    Likes Received:
    39
    Gender:
    Male
    Screaming frog is used to crawl the links of a website, not its content.

    Could you be more precise and explain us what you want to do exactly ?