google is indexing and deindexind me. how?

Discussion in 'Link Building' started by icemusike, Jan 3, 2010.

  1. icemusike

    icemusike BANNED BANNED

    Joined:
    Oct 22, 2008
    Messages:
    161
    Likes Received:
    71
    hello friends, i ahve a serious problem over here. you see google is messing witrh me. he is indexing me , deindexing and so on
    well i got indext my main page but not completly only the link.. no description no title. aldough i did put everything right with seo all in one plugin for wordpress
    next day a post from my site was indexed realy nice when i searched " site:domain.info there i was a new post idnexed, next day it was no more, copuple of days later another post idnexet good, now its deindexed. how come?? i mean what could it be the problem? why arent all my pages get idnext when the botts are crawling my website?

    my robots.txt are now like so: are there good?

    Code:
    User-agent: *
    Allow: /
    Disallow: /cgi-bin
    Disallow: /wp-admin
    Disallow: /wp-includes
    Disallow: /wp-content
    Disallow: /search/*/feed
    Disallow: /search/*/*
    
    User-agent: Mediapartners-Google
    Allow: /
    
    User-agent: Adsbot-Google
    Allow: /
    
    User-agent: Googlebot-Image
    Allow: /
    
    User-agent: Googlebot-Mobile
    Allow: /
    
    #User-agent: ia_archiver-web.archive.org
    #Disallow: /
    
    Sitemap: http://www.askapache.com/sitemap.xml
    
    i submited the sitemap all that it seems like yahoo has indexed 2 pages of mine same way. and why does bots wont idnex htem all i mean ai add fresh content every day like 10 posts.
    how can i get crawled more often?
    can anyone tell me some good hints? i tryed like all i could find her on bhw about seo.
     
  2. BruceW4yne

    BruceW4yne Newbie

    Joined:
    Apr 1, 2008
    Messages:
    47
    Likes Received:
    2
    Move the section for all bots to the bottom, it could cause confusion. See below.

    Code:
    User-agent: Mediapartners-Google
    Allow: /
    
    User-agent: Adsbot-Google
    Allow: /
    
    User-agent: Googlebot-Image
    Allow: /
    
    User-agent: Googlebot-Mobile
    Allow: /
    
    #User-agent: ia_archiver-web.archive.org
    #Disallow: /
    
    User-agent: *
    Allow: /
    Disallow: /cgi-bin
    Disallow: /wp-admin
    Disallow: /wp-includes
    Disallow: /wp-content
    Disallow: /search/*/feed
    Disallow: /search/*/*
    
    Sitemap: http://www.askapache.com/sitemap.xml
    Also, I don't know if User-Agent: Allow is proper usage. From Google's site the way to allow adsense bot access is like this:

    Code:
    User-agent: Mediapartners-Google
    Disallow:
    
    I've been having the same problems with the Google dance.