What is your way to extract data from ScreamingFrog?

McGrady

Junior Member

Feb 6, 2010

174

83

• Apr 7, 2016

• #1

Hello everybody!

I have a simple problem with ScreamingFrog, i love this software and i think it is one of the most powerful crawlers out there.

But i'm wasting so much time on extracting and analysing data using Excel Sheets.

What is your way to do a full website audit with screamingfrog without wasting all this time on a excel sheet?

Thanks !

 

D

deadpixle

Newbie

Apr 2, 2016

11

0

• Apr 7, 2016

• #2

Rather than exporting the whole crawl you can view the data in sections. For example if you wanted to comment on website parameters you would hit URI tab, select parameters from the little drop down. Export that csv. From here you can filter by which parameter URLs have canonically etc. I would drag filtered csv into Google Drive and then link to it from my audit doc.

 

Devil Rider

BANNED FOR SPAM/FAKE REVIEWS

Jul 24, 2015

552

60

• Apr 23, 2016

• #3

The SEO Spider not only fetches user and session metrics, but it can also collect goal conversions and e-commerce (transactions and revenue) data for landing pages, so you can view your top performing pages when performing a technical or content audit.

 

blackbeans

Elite Member

Nov 29, 2008

9,247

4,806

• Apr 28, 2016

• #4

I'm sorry to be the one to break this to you but if you want highly accurate bolt information, you need to do it manually.

The good news is that you only need to hire a virtual assistant from places like the Philippines, India or any other country where the huge population of people speak English as a second language.

There are lots of highly affordable virtual assistants that can manually parse the Screaming Frog data that you have.

Not only is it cheap but your chances of actually getting a lot of value from your data increases tremendously.

I would stay up steer clear of automated filtering programs and software.

 

Street Fighter

Elite Member

Jr. VIP

Aug 4, 2015

6,023

804

• Apr 30, 2016

• #5

Spider the website you're working within Screaming Frog. Just type the URL in the box and click go, and off it goes getting all the data from your website.

 

B

bellissimo

Newbie

Apr 4, 2017

22

2

• Jul 11, 2017

• #6

Screaming Frog is one of the best ones crawlers out there. It`s a shame you cannot use it for bigger websites

 

SearchEngineWays

Elite Member

Jr. VIP

Dec 3, 2014

5,650

662

• Jul 11, 2017

• #7

McGrady said:

Hello everybody!

I have a simple problem with ScreamingFrog, i love this software and i think it is one of the most powerful crawlers out there.

But i'm wasting so much time on extracting and analysing data using Excel Sheets.

What is your way to do a full website audit with screamingfrog without wasting all this time on a excel sheet?

Thanks !

Click to expand...

Watch this video

 

MrPenguin

Junior Member

Mar 10, 2010

114

18

• Jul 18, 2017

• #8

The custom extraction feature allows you to scrape any data from the HTML of a web page using CSS Path, XPath and regex. The extraction is performed on the static HTML returned from URLs crawled by the SEO Spider, which return a 200 ‘OK’ response

 

SOCIALSEOGUY

Junior Member

May 26, 2015

137

19

• Jul 18, 2017

• #9

use ctrl+f to find your specific data in excel. if it can be filtered then do it.