black_ice007
Regular Member
- Nov 28, 2007
- 354
- 146
I saw this tread on another forum, but not one answered they guy. Thought I'd asked the question here:
I'm thinking of using this as my robots.txt:
User-agent: Googlebot
Disallow: /
User-agent: Googlebot-Image
Disallow: /
User-agent: msnbot
Disallow: /
User-agent: Slurp
Disallow: /
User-agent: yahoo-mmcrawler
Disallow: /
User-agent: yahoo-blogs/v3.9
Disallow: /
The reason is in order Google, Yahoo, and MSN bot cannot index my page, but the adwords bot (AdsBot-Google) and other PPC bot can. This is for A/B testing, also with SPPC we get tons of different LP version if you make the LP dynamic. I'm thinking if my content get indexed it may lower my QS. Is this the right move?
==========================================================
Also, what about stopping the AdsBot-Google (adwords bot) when putting up a campaign...would this lower your QS?
I'm thinking of using this as my robots.txt:
User-agent: Googlebot
Disallow: /
User-agent: Googlebot-Image
Disallow: /
User-agent: msnbot
Disallow: /
User-agent: Slurp
Disallow: /
User-agent: yahoo-mmcrawler
Disallow: /
User-agent: yahoo-blogs/v3.9
Disallow: /
The reason is in order Google, Yahoo, and MSN bot cannot index my page, but the adwords bot (AdsBot-Google) and other PPC bot can. This is for A/B testing, also with SPPC we get tons of different LP version if you make the LP dynamic. I'm thinking if my content get indexed it may lower my QS. Is this the right move?
==========================================================
Also, what about stopping the AdsBot-Google (adwords bot) when putting up a campaign...would this lower your QS?