Advanced SEO Question: I have a responsive design, how do I control what googlebot sees?

Taktical

Elite Member
Joined
May 15, 2011
Messages
1,641
Reaction score
3,343
I've ranked my clients site for really tough keywords worth millions. Now they're launching a crazy redesign with a lot of complex java. The site is responsive, meaning that different browsers get different versions of the code.

Thats not the problem. The problem is the because the site is so complex, using HTML5, AJAX and javascript, that the code is WILDLY different from one browser to the next. For example, safari on mac sees all the content nice and clean, just the way you'd like it. On chrome however, you can't see even one word of text, its all referenced in external java files.

Now i've checked how the site looks to googlebot, and of course its the chrome version that i dont want it to see. Can I control what version of the responsive design googlebot sees? How can i direct the site to call up the correct version when googlebot comes across it?

If thats not possible, which browser should i optimize the code for so that googlebot sees it?

Thanks!
 
search engines in particular crawl pages and if there is something in particular hiding or not allowing google to crawl those pages then of course you may not see the text. perhaps check robots.txt? and check if there is any directory that is being hidden or unallowed to crawl perhaps that could be the issue?
 
search engines in particular crawl pages and if there is something in particular hiding or not allowing google to crawl those pages then of course you may not see the text. perhaps check robots.txt? and check if there is any directory that is being hidden or unallowed to crawl perhaps that could be the issue?

I appreciate your attempt at helping, but either you didn't read my post carefully or this issue might be over your head. perhaps someone with more expertise should help.

thank you for trying though!
 
You could redirect google bots to specific site that you want them to see. Some can be detected by user agents and some only by IP. There was a pretty good list of google bot IPs on Fantomaster cloacking script while ago but I'm not sure if it is available anymore.

Code:
[COLOR=#000000][B]<?php[/B][/COLOR]   [COLOR=#000088]
$useragent[/COLOR] [COLOR=#339933]=[/COLOR] [COLOR=#000088]$_SERVER[/COLOR][COLOR=#009900][[/COLOR][COLOR=#0000ff]'HTTP_USER_AGENT'[/COLOR][COLOR=#009900]][/COLOR][COLOR=#339933];[/COLOR]
[COLOR=#b1b100]if[/COLOR][COLOR=#009900]([/COLOR] [URL="http://www.php.net/strpos"][COLOR=#990000]strpos[/COLOR][/URL][COLOR=#009900]([/COLOR][COLOR=#000088]$useragent[/COLOR][COLOR=#339933],[/COLOR][COLOR=#0000ff]"Google User Agent"[/COLOR][COLOR=#009900])[/COLOR] [COLOR=#009900])[/COLOR] [COLOR=#009900]{[/COLOR]
     [URL="http://www.php.net/header"][COLOR=#990000]header[/COLOR][/URL][COLOR=#009900]([/COLOR][COLOR=#0000ff]"Location: index2.php"[/COLOR][COLOR=#009900])[/COLOR][COLOR=#339933];[/COLOR]
 [COLOR=#009900]}[/COLOR]
[COLOR=#000000][B]?>[/B][/COLOR]

Code:
<?php

$ip = $_SERVER['REMOTE_ADDR'];
if (preg_match("/Google.IP/",$ip)) {

      header('Location: index2.php');

};

?>

If you have more control over you clients website you can also modify their script to show content based on the IP/User agent.

Code:
<?php
$ip = $_SERVER['REMOTE_ADDR'];
if (preg_match("/Google.IP/",$ip)) {
WEBSITE CONTENT
}else{
WEBSITE CONTENT
};
?>
 
Last edited:
I'm not sure what you're trying to say, but if you create a responsive website, make sure to not hide any content - The content a user with big screen see, a user with small screen will have to see too. Of course, in a different layout, but the content and the HTML has to be the same. I assume you're using CSS3 media queries to make your layout responsive, right?

I don't recommend to use lots of AJAX requests, since Googlebot aren't able to read.
 
Thank you

You could redirect google bots to specific site that you want them to see. Some can be detected by user agents and some only by IP. There was a pretty good list of google bot IPs on Fantomaster cloacking script while ago but I'm not sure if it is available anymore.

Code:
[COLOR=#000000][B]<?php[/B][/COLOR]   [COLOR=#000088]
$useragent[/COLOR] [COLOR=#339933]=[/COLOR] [COLOR=#000088]$_SERVER[/COLOR][COLOR=#009900][[/COLOR][COLOR=#0000ff]'HTTP_USER_AGENT'[/COLOR][COLOR=#009900]][/COLOR][COLOR=#339933];[/COLOR]
[COLOR=#b1b100]if[/COLOR][COLOR=#009900]([/COLOR] [URL="http://www.php.net/strpos"][COLOR=#990000]strpos[/COLOR][/URL][COLOR=#009900]([/COLOR][COLOR=#000088]$useragent[/COLOR][COLOR=#339933],[/COLOR][COLOR=#0000ff]"Google User Agent"[/COLOR][COLOR=#009900])[/COLOR] [COLOR=#009900])[/COLOR] [COLOR=#009900]{[/COLOR]
     [URL="http://www.php.net/header"][COLOR=#990000]header[/COLOR][/URL][COLOR=#009900]([/COLOR][COLOR=#0000ff]"Location: index2.php"[/COLOR][COLOR=#009900])[/COLOR][COLOR=#339933];[/COLOR]
 [COLOR=#009900]}[/COLOR]
[COLOR=#000000][B]?>[/B][/COLOR]

Code:
<?php

$ip = $_SERVER['REMOTE_ADDR'];
if (preg_match("/Google.IP/",$ip)) {

      header('Location: index2.php');

};

?>

If you have more control over you clients website you can also modify their script to show content based on the IP/User agent.

Code:
<?php
$ip = $_SERVER['REMOTE_ADDR'];
if (preg_match("/Google.IP/",$ip)) {
WEBSITE CONTENT
}else{
WEBSITE CONTENT
};
?>
 
Back
Top