1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

What is your way to extract data from ScreamingFrog?

Discussion in 'White Hat SEO' started by McGrady, Apr 7, 2016.

  1. McGrady

    McGrady Registered Member

    Joined:
    Feb 6, 2010
    Messages:
    77
    Likes Received:
    18
    Occupation:
    Student
    Location:
    Paris
    Hello everybody!

    I have a simple problem with ScreamingFrog, i love this software and i think it is one of the most powerful crawlers out there.

    But i'm wasting so much time on extracting and analysing data using Excel Sheets.

    What is your way to do a full website audit with screamingfrog without wasting all this time on a excel sheet?

    Thanks !
     
  2. deadpixle

    deadpixle Newbie

    Joined:
    Apr 2, 2016
    Messages:
    11
    Likes Received:
    0
    Rather than exporting the whole crawl you can view the data in sections. For example if you wanted to comment on website parameters you would hit URI tab, select parameters from the little drop down. Export that csv. From here you can filter by which parameter URLs have canonically etc. I would drag filtered csv into Google Drive and then link to it from my audit doc.
     
  3. Devil Rider

    Devil Rider BANNED BANNED

    Joined:
    Jul 24, 2015
    Messages:
    554
    Likes Received:
    59
    The SEO Spider not only fetches user and session metrics, but it can also collect goal conversions and e-commerce (transactions and revenue) data for landing pages, so you can view your top performing pages when performing a technical or content audit.
     
  4. blackbeans

    blackbeans Jr. VIP Jr. VIP

    Joined:
    Nov 29, 2008
    Messages:
    1,410
    Likes Received:
    245
    Occupation:
    Your Secret Weapon
    Home Page:
    I'm sorry to be the one to break this to you but if you want highly accurate bolt information, you need to do it manually.

    The good news is that you only need to hire a virtual assistant from places like the Philippines, India or any other country where the huge population of people speak English as a second language.

    There are lots of highly affordable virtual assistants that can manually parse the Screaming Frog data that you have.

    Not only is it cheap but your chances of actually getting a lot of value from your data increases tremendously.

    I would stay up steer clear of automated filtering programs and software.
     
  5. Street Fighter

    Street Fighter Jr. VIP Jr. VIP Premium Member

    Joined:
    Aug 4, 2015
    Messages:
    1,073
    Likes Received:
    228
    Gender:
    Male
    Occupation:
    Link Builder
    Location:
    In Street
    Spider the website you're working within Screaming Frog. Just type the URL in the box and click go, and off it goes getting all the data from your website.
     
  6. bellissimo

    bellissimo Newbie

    Joined:
    Apr 4, 2017
    Messages:
    22
    Likes Received:
    2
    Gender:
    Male
    Screaming Frog is one of the best ones crawlers out there. It`s a shame you cannot use it for bigger websites
     
  7. SearchEngineWays

    SearchEngineWays Jr. VIP Jr. VIP

    Joined:
    Dec 3, 2014
    Messages:
    283
    Likes Received:
    80
    Gender:
    Male
    Occupation:
    SEARCH ENGINE MARKETING
    Location:
    Search Engine Result Page
    Watch this video :)

     
  8. MrPenguin

    MrPenguin Jr. VIP Jr. VIP

    Joined:
    Mar 10, 2010
    Messages:
    114
    Likes Received:
    16
    The custom extraction feature allows you to scrape any data from the HTML of a web page using CSS Path, XPath and regex. The extraction is performed on the static HTML returned from URLs crawled by the SEO Spider, which return a 200 ‘OK’ response
     
  9. SOCIALSEOGUY

    SOCIALSEOGUY Registered Member

    Joined:
    May 26, 2015
    Messages:
    87
    Likes Received:
    11
    Location:
    In Your GF Mind
    Home Page:
    use ctrl+f to find your specific data in excel. if it can be filtered then do it.