Interesting read.
http://www.scribd.com/doc/217994742/General-Guidelines-1
Here is the Contents
General Guidelines Version 5.0
March 31, 2014
General Guidelines Overview ................................................................................. 5
Part 1: Page Quality Rating Guideline ................................................................... 6
1.0 Introduction to Page Quality Rating ................................................................................................................. 6
2.0 Understanding Webpages and Websites ........................................................................................................ 6
2.1 Important Definitions ................................................................................................................................ 6
2.2 What is the Purpose of a Webpage? ....................................................................................................... 7
2.3 Your Money or Your Life (YMYL) Pages.................................................................................................. 8
2.4 Understanding Webpage Content ........................................................................................................... 8
2.5 Understanding the Website .................................................................................................................... 10
2.6 Website Maintenance .............................................................................................................................. 14
2.7 Website Reputation ................................................................................................................................. 15
3.0 Overall Page Quality Rating Scale ................................................................................................................. 18
4.0 High Quality Pages .......................................................................................................................................... 18
4.1 Characteristics of High Quality Pages .................................................................................................. 18
4.2 A Satisfying Amount of High Quality Main Content ............................................................................ 19
4.3 A High Level of Expertise/Authoritativeness/Trustworthiness (E-A-T) ............................................. 20
4.4 Positive Reputation ................................................................................................................................. 20
4.5 Helpful Supplementary Content ............................................................................................................. 20
4.6 Functional Page Design .......................................................................................................................... 21
4.7 A Satisfying Amount of Website Information ....................................................................................... 21
4.8 A Well Cared For and Maintained Website ........................................................................................... 22
4.9 Examples of High Quality Pages ........................................................................................................... 22
5.0 Highest Quality Pages ..................................................................................................................................... 26
5.1 Very High Quality MC .............................................................................................................................. 26
5.2 Very High Level of E-A-T ........................................................................................................................ 26
5.3 Very Positive Reputation ........................................................................................................................ 26
5.4 Examples of Highest Quality Pages ...................................................................................................... 26
6.0 Low Quality Pages ............................................................................................................................................ 32
6.1 Low Quality Main Content ...................................................................................................................... 33
6.2 Unsatisfying Amount of Main Content .................................................................................................. 33
6.3 Lacking Expertise, Authoritativeness, or Trustworthiness (E-A-T) ................................................... 33
6.4 Negative Reputation ................................................................................................................................ 34
6.5 Characteristics Which May Be Evidence of Low Quality .................................................................... 34
6.6 Examples of Low Quality Pages ............................................................................................................ 36
Proprietary and Confidential ? Copyright 2014
7.0 Lowest Quality Pages ....................................................................................................................................... 39
7.1 Harmful or Malicious Pages ................................................................................................................... 40
7.2 Lack of Purpose Pages ........................................................................................................................... 40
7.3 Deceptive Pages ...................................................................................................................................... 40
7.4 Lowest Quality Main Content ................................................................................................................. 42
7.5 No Website Information .......................................................................................................................... 45
7.6 Highly Untrustworthy, Unreliable, Unauthoritative, Inaccurate, or Misleading ................................ 46
7.7 Abandoned Websites or Spammed Pages on a Website .................................................................... 46
7.8 Extremely Negative or Malicious Reputation ....................................................................................... 46
7.9 Examples of Lowest Quality Pages ....................................................................................................... 47
8.0 Medium Quality Pages ...................................................................................................................................... 53
8.1 Examples of Medium Quality Pages ...................................................................................................... 54
9.0 Page Quality Rating: Important Considerations ............................................................................................ 57
9.1 Instructions for Rating Page Quality Tasks .......................................................................................... 57
9.2 The Top Three PQ Considerations ........................................................................................................ 57
9.3 E-A-T: Page or Website? ........................................................................................................................ 58
10.0 Page Quality Considerations for Specific Types of Pages ......................................................................... 58
10.1 Ratings for Encyclopedia Pages .......................................................................................................... 58
10.2 Ratings for Pages with Error Messages or No MC ............................................................................ 58
10.3 Ratings for Forums and Q&A pages ................................................................................................... 60
11.0 Page Quality Rating FAQs ............................................................................................................................. 64
Part 2: Utility Rating Guideline ............................................................................ 66
12.0 Introduction to Utility Rating ......................................................................................................................... 66
12.1 Important Rating Definitions and Ideas ............................................................................................ 66
12.2 The Purpose of Search Quality Rating ................................................................................................ 67
12.3 Raters Must Represent the User .......................................................................................................... 67
12.4 Browser Requirements ......................................................................................................................... 67
12.5 Ad Blocking Extensions ....................................................................................................................... 67
12.6 Internet Safety Information ................................................................................................................... 67
12.7 Releasing Tasks .................................................................................................................................... 68
13.0 Understanding the Query ............................................................................................................................... 68
13.1 Understanding User Intent ................................................................................................................... 68
13.2 Task Language and Task Location (Locale) ....................................................................................... 69
13.3 Queries with Multiple Meanings ........................................................................................................... 69
13.4 Query Meanings Can Change Over Time ............................................................................................ 71
13.5 Classification of User Intent: Action, Information, and Navigation: Do-Know-Go ........................ 72
Proprietary and Confidential ? Copyright 2014 2
14.0 Utility Rating Scale for Result Blocks ........................................................................................................... 73
14.1 Vital (V) ................................................................................................................................................... 87
14.2 Useful (U) ................................................................................................................................................ 95
14.3 Relevant (R) ............................................................................................................................................ 99
14.4 Slightly Relevant (SR) ......................................................................................................................... 101
14.5 Off-Topic or Useless (OT) ................................................................................................................... 103
15.0 Rating Porn (P), Foreign Language (F), and Didn?t Load (D) Results ..................................................... 107
15.1 Porn (P) Flag ........................................................................................................................................ 107
15.2 Porn Result Utility Rating ................................................................................................................... 107
15.3 Reporting Illegal Images ..................................................................................................................... 109
15.4 Foreign Language Results ................................................................................................................. 110
15.5 Rating Results with Content that Doesn?t Load ............................................................................... 113
16.0 Location and Utility Rating .......................................................................................................................... 115
16.1 Locale is Important.............................................................................................................................. 115
16.2 Queries that ?Ask? for Nearby Results or Nearby Information ...................................................... 118
16.3 User Location and Understanding the Query ................................................................................... 121
16.4 Queries with an Explicit Location ...................................................................................................... 123
16.5 Vital Ratings for Queries with a User Location ................................................................................ 124
16.6 Rating Queries with User Location and Explicit Location .............................................................. 125
16.7 Rating Local Intent Queries ................................................................................................................ 125
16.8 Rating Examples with User Location, Explicit Location, and Local Intent ................................... 125
Part 3: Block Utility Rating Guideline ............................................................... 129
17.0 Overview of Block Utility (BU) Rating ......................................................................................................... 129
18.0 The Relationship between PQ and Utility ................................................................................................... 129
19.0 Queries with Multiple Interpretations and Intents ..................................................................................... 131
20.0 Specificity of Queries and Landing Pages ................................................................................................. 133
21.0 Utility and Freshness .................................................................................................................................... 139
22.0 Misspelled and Mistyped Queries and Results .......................................................................................... 143
22.1 Misspelled and Mistyped Queries ....................................................................................................... 143
22.2 Name Queries ....................................................................................................................................... 143
22.3 Spelling Suggestion Result Blocks .................................................................................................... 145
23.0 Non-Vital Results for URL Queries .............................................................................................................. 149
24.0 Product Queries: Action (Do) vs. Information (Know) Intent ................................................................... 150
25.0 Mobile Landing Pages .................................................................................................................................. 151
Proprietary and Confidential ? Copyright 2014 3
Part 4: Using the Evaluation Platform .............................................................. 153
26.0 Introduction ................................................................................................................................................... 153
27.0 Accessing the Evaluation Platform (EP)..................................................................................................... 153
28.0 Evaluation Platform Screenshot .................................................................................................................. 153
29.0 Block Utility Task Page Screenshot ............................................................................................................ 154
30.0 Notes about Using the Block Utility Rating Interface ................................................................................ 156
31.0 Using the ?Report a Problem / Release this Task? Button ....................................................................... 156
32.0 Reporting Results with Duplicate Landing Pages ..................................................................................... 157
33.0 Using the Page Quality Rating Scale in Block Utility Rating Tasks ........................................................ 160
Proprietary and Confidential ? Copyright 2014 4
?expertise, authoritativeness and trustworthiness?
http://www.scribd.com/doc/217994742/General-Guidelines-1
