Listing Indexed Pages In Excel

informavore7

Newbie
Joined
May 1, 2013
Messages
14
Reaction score
0
I have a site that's migrating and completely changing navigation. It has really good organic traffic so naturally I'm trying to be extra careful I don't screw that up. I want to make sure I get all the indexed pages and do a 301 redirect for each. I know you can pull the first 1000 listings through Google docs but this site has over 3000 pages (lots of blog posts that weren't called blog posts, then some that were listed as pages that now need to be posts, it's a real mess but great content).
Besides going through one by one - is there anything out there that will pull all the indexed page urls into an excel spreadsheet?
Thanks for any help you can provide.
 
Your web server access logs have all the important URLs. Import the logs into excel and create a pivot table on the protocol, host, and URL path and sort by count descending. This will give you the prioritized list of which ones are most important to do first.

And fix the important 404 and 500 errors since you are in the logs anyway. :)
 
Last edited:
How far back do you go in the logs for this? I have one month but I'm thinking is there any relevance in going back more? Like a year?

Just include 1-3 months... this will pick up your user activity as well as your googlebot crawled pages... that should cover everything that is visited or crawled by google.
 
Back
Top