1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Google Crawl Errors

Discussion in 'White Hat SEO' started by webhandler, Mar 21, 2014.

  1. webhandler

    webhandler Newbie

    Joined:
    May 10, 2013
    Messages:
    25
    Likes Received:
    2
    Home Page:
    When I go to my google webmaster account, I have about 600,000 submitted pages with only 200 showing as indexed and when I do a google search of my indexed pages the SERPS i get are around 238,000 pages. With that said I am one confused puppy as to what numbers to run with and also why are all this pages submitted but they are not being indexed. I am not getting any errors like 404, 500 or anything. What I'm I missing. what should I do to have google crawl my site more often in a day and WHAT should I do to get them all indexed? Thanks in advance.
     
  2. ContentWriter

    ContentWriter Jr. VIP Jr. VIP

    Joined:
    May 8, 2013
    Messages:
    1,799
    Likes Received:
    211
    Occupation:
    Content Writer
    Home Page:
    When did you start submitting those 600,000 pages?
     
    • Thanks Thanks x 1
  3. webhandler

    webhandler Newbie

    Joined:
    May 10, 2013
    Messages:
    25
    Likes Received:
    2
    Home Page:
    It has been about month or so...
     
  4. webhandler

    webhandler Newbie

    Joined:
    May 10, 2013
    Messages:
    25
    Likes Received:
    2
    Home Page:
    First 222000 were two months ago and took about three weeks to index on the SERPS. Next 40,000 only got about half indexed on SERPs and then we uploaded another 300,000 a week ago. Nothing has shown up anywhere yet.
     
  5. ContentWriter

    ContentWriter Jr. VIP Jr. VIP

    Joined:
    May 8, 2013
    Messages:
    1,799
    Likes Received:
    211
    Occupation:
    Content Writer
    Home Page:
    If it took 3 weeks for the first batch, and it has been just a week for the next batch, I think you just need to patiently wait for 2 more weeks. If a vast majority of the second batch isn't indexed after 2 more weeks, I guess you may report this to Google's Support team.

    However, sometimes, Google crawls on pages and posts in a matter of minutes only.
     
    • Thanks Thanks x 1
  6. webhandler

    webhandler Newbie

    Joined:
    May 10, 2013
    Messages:
    25
    Likes Received:
    2
    Home Page:
    Thanks much. I am coming to see that it is more of a patience thing. What would contacting google do for me and how do I go about it if you don't mind my asking?
     
  7. ContentWriter

    ContentWriter Jr. VIP Jr. VIP

    Joined:
    May 8, 2013
    Messages:
    1,799
    Likes Received:
    211
    Occupation:
    Content Writer
    Home Page:
  8. webhandler

    webhandler Newbie

    Joined:
    May 10, 2013
    Messages:
    25
    Likes Received:
    2
    Home Page:
    So I figured out that most of my pages have been crawled by google but about half of them are being blocked by robots and I can't seem to figure out how to fix that. any help or pointing me to the right direction will be highly appreciated. I have an idea it might be the robots.txt file but I want a more descriptive answer on how to tackle this. Thanks.