1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Listing Indexed Pages In Excel

Discussion in 'White Hat SEO' started by informavore7, Jun 15, 2016.

  1. informavore7

    informavore7 Newbie

    Joined:
    May 1, 2013
    Messages:
    12
    Likes Received:
    0
    I have a site that's migrating and completely changing navigation. It has really good organic traffic so naturally I'm trying to be extra careful I don't screw that up. I want to make sure I get all the indexed pages and do a 301 redirect for each. I know you can pull the first 1000 listings through Google docs but this site has over 3000 pages (lots of blog posts that weren't called blog posts, then some that were listed as pages that now need to be posts, it's a real mess but great content).
    Besides going through one by one - is there anything out there that will pull all the indexed page urls into an excel spreadsheet?
    Thanks for any help you can provide.
     
  2. validseo

    validseo Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 17, 2013
    Messages:
    906
    Likes Received:
    521
    Occupation:
    Professional SEO
    Location:
    Seattle, Wa
    Your web server access logs have all the important URLs. Import the logs into excel and create a pivot table on the protocol, host, and URL path and sort by count descending. This will give you the prioritized list of which ones are most important to do first.

    And fix the important 404 and 500 errors since you are in the logs anyway. :)
     
    • Thanks Thanks x 1
    Last edited: Jun 15, 2016
  3. informavore7

    informavore7 Newbie

    Joined:
    May 1, 2013
    Messages:
    12
    Likes Received:
    0
    Thank you so much. This will help a lot!
     
  4. informavore7

    informavore7 Newbie

    Joined:
    May 1, 2013
    Messages:
    12
    Likes Received:
    0
    How far back do you go in the logs for this? I have one month but I'm thinking is there any relevance in going back more? Like a year?
     
  5. validseo

    validseo Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 17, 2013
    Messages:
    906
    Likes Received:
    521
    Occupation:
    Professional SEO
    Location:
    Seattle, Wa
    Just include 1-3 months... this will pick up your user activity as well as your googlebot crawled pages... that should cover everything that is visited or crawled by google.
     
    • Thanks Thanks x 1