1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Google Indexing Issues with Wordpress

Discussion in 'White Hat SEO' started by SuperLinks, Sep 8, 2010.

  1. SuperLinks

    SuperLinks Elite Member

    Joined:
    Jul 14, 2008
    Messages:
    2,903
    Likes Received:
    847
    Location:
    New York
    So I am having a bit of trouble with Wordpress and indexing. Google is indexing my site at an incredible rate, which is obviously great. Although it is indexing pages that don't exist.

    For example, I currently have pages indexed for mydomain.com/uncategorized/blogtitle when the actual url is mydomain.com/somecategory/blogtitle. I have NEVER posted these under uncategorized and in fact see ZERO links from anywhere on my site to uncategorized. Every single post is categorized. When I personally visit the uncategorized URL it redirects me to the proper URL. When I check Google's cache, it shows the uncategorized URL.

    Problem #2. I am using MaxBlogPress ********** Affiliate plug-in to manage my affiliate links. Google is INDEXING these links. For example the URLs that I use are a completely made up "folder" since you can make the URL be whatever you want when you create them. Right now all links are in the same URL structure, mydomain.com/goto/affiliatelink. Google is now indexing these links!

    Since they are in a made up directory that doesn't exist, mydomain.com/GOTO/affiliate link can I make an .htaccess that denies access to these? How can I make it so that Google isn't indexing these?

    Any suggestions on why Google's also indexing them under uncategorized AND the right category when I cannot understand HOW Google is finding these links in the first place since I've never categorized the posts as uncategorized?
     
  2. Linalin

    Linalin Junior Member

    Joined:
    Apr 29, 2010
    Messages:
    138
    Likes Received:
    31
    Gender:
    Female
    Occupation:
    Graphic/web entrepreneur
    Location:
    Nigeria
    Home Page:
    puzzling? there is no reason they should be indexed , but I'm a little confused what do you mean they are in a made up directory?
     
  3. magicjg

    magicjg Junior Member

    Joined:
    Sep 2, 2009
    Messages:
    102
    Likes Received:
    28
    Location:
    SoCal
    Home Page:
    That is one of the strangest things I've heard in awhile. Have you looked at your sitemap to see if any uncategorized URLs are in there?
     
  4. SuperLinks

    SuperLinks Elite Member

    Joined:
    Jul 14, 2008
    Messages:
    2,903
    Likes Received:
    847
    Location:
    New York
    Ya I have looked far and wide, there are literally ZERO links to ANY uncategorized posts. In fact I have ZERO posts on my whole site under uncategorized.

    In reference to the made up directory, with MaxBlogPress N*I*NJA Aff*iliate software. The software helps you manage jumps to affiliate links and cloaking. All my affiliate links are setup as mydomain.com/GOTO/affiliate link. The GOTO doesn't exist as a folder (which means that I don't think I can setup a folder or an .htaccess to have them not indexed)

    To rephrase, Google is indexing my affiliate/cloaked links! These are only links to the sites and for some reason Google has them indexed. Anyone have any ideas on either problems or how I could get Google to stop indexing them?
     
  5. SuperLinks

    SuperLinks Elite Member

    Joined:
    Jul 14, 2008
    Messages:
    2,903
    Likes Received:
    847
    Location:
    New York
    Looks like I have found another example of a site that is having a similar problem. Check out the following URL: reviewbonus4u.com and look at the pages indexed in Google. You will notice that his affiliate jump links are also getting indexed by Google. Notice how www.reviewbonus4u.com/go/affiliate-pilot/ is indexed? This is an affiliate link as well but Google is indexing it. I'm guessing that he too is using the same plugin.
     
    Last edited: Sep 10, 2010
  6. MisterGemini

    MisterGemini Senior Member

    Joined:
    May 25, 2010
    Messages:
    1,113
    Likes Received:
    714
    Occupation:
    Observe & Report
    Location:
    Alternate Universe
    Is this on a shared host with the same IP? A badly configured web host can produce these kinds quirky results.
     
  7. SuperLinks

    SuperLinks Elite Member

    Joined:
    Jul 14, 2008
    Messages:
    2,903
    Likes Received:
    847
    Location:
    New York
    Yes this is actually on a shared host. I have seen other similarities with others using the N*INJA* A**FF*ILIATE plugin. Like the example shown above. Any ideas? If I created either an htaccess or robots.txt file could that solve my problem with it indexing those affiliate jump links?
     
  8. Scripteen

    Scripteen Elite Member

    Joined:
    Sep 19, 2009
    Messages:
    1,811
    Likes Received:
    1,918
    Home Page:
    block mydomain.com/uncategorized/ in robots.txt and get some backlinks to the correct urls from external pages.
     
  9. MisterGemini

    MisterGemini Senior Member

    Joined:
    May 25, 2010
    Messages:
    1,113
    Likes Received:
    714
    Occupation:
    Observe & Report
    Location:
    Alternate Universe

    Do that.
     
  10. SuperLinks

    SuperLinks Elite Member

    Joined:
    Jul 14, 2008
    Messages:
    2,903
    Likes Received:
    847
    Location:
    New York
    Thanks for the suggestion. I'll do that. I also have a ton of links hitting the correct URLs. Should I do the same with the affiliate jump "folder" too? Meaning blog mydomain.com/GOTO/ in robots?
     
  11. robotluv

    robotluv Junior Member

    Joined:
    Aug 3, 2010
    Messages:
    100
    Likes Received:
    28
    First things first. Let's get rid of these nasty 404s that GOOG's detecting because it's finding things that don't exist.

    Open up your .htaccess file (assuming you're using Apache) and add some 301 redirects back to your homepage for all of these 404s.

    To find them all, do a site: domainname.com and then see everything that is indexed. Click on them all and the ones that don't exist you need to 301 redirect ASAP.

    Additionally, install Google Webmaster Tools and check and see if it's throwing up some more errors that you aren't seeing.

    I've had GOOG index /uncategorized/ before. I just fix it with 301s. All is good then. You can also block it via robots.txt. That helps, but GOOG doesn't always obey - immediately.

    Secondly, block all those other things via robots.txt and 301 redirect them.

    My guess is that you've got some links somewhere on your website, perhaps in a footer, or hidden somewhere that the spiders are finding and following. Check your source code then do a search through it for those folders/links/directories. It's got to be hidden in there somewhere, on some page, and it's getting scraped by the ole spider.
     
    Last edited: Sep 10, 2010
  12. utkarshpaliwal

    utkarshpaliwal Regular Member

    Joined:
    Jun 8, 2009
    Messages:
    498
    Likes Received:
    88
    I am reading this for the 1st time... Never faced this type of situation !
    I will advice to keep on building the links!
    All the best!
     
  13. AutoBlogger

    AutoBlogger Power Member

    Joined:
    Oct 20, 2009
    Messages:
    780
    Likes Received:
    928
    Occupation:
    IM, AutoBlogging and Urban Planning
    Location:
    The Global Village
    Interlink your pages and ping frequently. And keep your archive in deindex mode.