MrBlue
Senior Member
- Dec 18, 2009
- 975
- 695
Sample:
Complete list here:
Code:
Crawling Google Trivia
How many bots does Google have?
More than 25 and less than 1,000
Crawling Hosting and Servers
Should I use the Vary HTTP header on URLs that redirect based on user-agent?
Yes, it's still used by Google though maybe not other services
Crawling Website Coding
How does Google handle "not found" pages that don't return a 404?
Google tends to treat as regular 404s
Crawling Website Content
Should I block Googlebot from crawling a dynamically generated calendar?
Yes
Crawling Website Performance Website Content
What are the top 3-5 SEO areas where webmasters make the most mistakes?
Not having a domain at all, not making it crawlable, not using words people search for on your page, not having compelling content, not having good titles and descriptions, not making use of webmaster resources.
Crawling
How can I make sure Google reaches my deeper pages?
Link to them from the root page
Crawling
Are nofollow links irrelevant?
They're irrelevant to search engines, but worth it to get visits
Crawling
Will Google improve its crawling of AJAX?
There is a team working on it. In general Google can handle some AJAX
Crawling
How many pages can Google index from a single site?
There's no real limit
Crawling
Why does Google index blogs faster than other sites?
...
Complete list here:
Code:
http://pastebin.com/raw.php?i=Uixgv5Hr