HRS Flashcards
(169 cards)
1
Q
What two lyric sources give authority
A
Gracenote
LyricFind
2
Q
If Query is for song what is most likely intent?
A
Purchase or download song from credible source, or watch video of song.
3
Q
What is the highest rating for lyric URL if Query does not mention lyrics or words?
A
Good. That’s because intent is only Likely to be lyrics.
If source is not highly credible, rating is a fair.
4
Q
If query is song words, what is the very likely intent
A
Lyrics. So the Highest rating can for lyrics in URL is excellent if authoritative source.
Good if not authoritative source.
5
Q
Query for Macy’s shoes with URL to Macy’s home page would be rated what?
A
Good.
I think home page is okay if they have to click again.
6
Q
Query for Macy’s shoes with URL to single Macy’s shoe page would be rated what?
A
Fair.
Way too narrow.
Strongly satisfies unlikely intent
7
Q
Query for Macy’s shoes with URL to watches would be rated what?
A
Bad.
(even though only a couple of clicks away. since this is not home page and is not okay to have a couple of clicks, it seems. confusing.)
8
Q
How should “Product could not be found” be rated?
A
PDNL. It may be temporary.
Permanent issues should be marked Bad. Temporary should be PDNL.
9
Q
Rating for:
You cannot determine the relevance of the LP because the LP appears relevant to the query, but the content is hidden
behind a login screen.
A
NJ: Login
10
Q
Rating for:
LP is login, you did not enter, but it is clear that LP is irrelevant to Query.
A
Bad
11
Q
If it is a login page but it is clear that this is the exactly right page, what should the rating be?
A
Perfect.
Example = AT&T GoPhone payment site for a query to refill AT&T prepaid
12
Q
Information behind paid account that is clear is relevant/good, but unlikely that user will have paid account or want to pay to get one.
A
Fair:
Example is IMDB pro (paid) where you can see what kind of stuff is there.
13
Q
Rating for:
Query: Facebook [real person]
URL: Facebook login page
A
Bad
Does not satisfy the intent
14
Q
When do you use NJ: Foreign?
A
When there appears to be a CONNECTION between the query and the LP, but you cannot determine the relevance of the LP because the content is in a language you don’t understand.
15
Q
What is the rating for:
When there appears to be a CONNECTION between the query and the LP, but you cannot determine the relevance of the LP because the content is in a language you don’t understand.
A
NJ: Foreign
16
Q
What is the rating when the LP is in a foreign language, but bears no relevance to the query?
A
Bad
17
Q
Rating for:
English speaking Australian queries the name of a song, and a wiki about the song comes up in Japanese
A
Bad.
Is very unlikely that Australian would be seeking Japanese content. (Well, I guess unless they specified)
18
Q
Rating for:
If an English speaker in India queries {Nokia x7} and a Nokia page comes up in Vietnamese
A
Bad
Is very unlikely an Indian user wants content in Vietnamese.
19
Q
What are the three possible types of user intents?
A
Navigational (N)
Informational (I)
Transactional (T)
20
Q
What is Navigational (N)
A
One of three user intents.
Find a specific page:
Usually a person, company, or brand name.
21
Q
What is Transactional (T)
A
One of three user intents.
Complete a transaction
Involves interaction with a web resource,
paid or free;
Query may include words like “buy”, “chat”, “register”, or “download”
22
Q
What is Informational (I)
A
One of three user intents.
Want to learn more about a topic
Query may contain words like “how to”, “what is”, “ways to”, or “review”.
23
Q
What are four reasons to rate
NJ: PDNL?
A
- Temporary issue so can’t determine relevance
- Page actually doesn’t load
- Automatically redirect to a search page
- LP Message that content is unavailable (and not sure if will be back)
24
Q
What is the shortcut key in the Bing Toolbar to get a page to reload?
A
Alt-W
25
One should always reload a page before assigning what rating?
NJ: PDNL
26
Do not rate NJ: PDNL if
- Says "under construction" while still being usable. Rate it.
- Expected content is unavailable and you're sure will be same in a month (company out of business or video has been removed). Rate as BAD
27
Rating if:
If expected content is unavailable and you're sure will be same in a month (company out of business or video has been removed).
BAD
28
Rating if:
Says "under construction" while still being usable.
Rate it
29
What are some common error codes that should be rated
NJ: PDNL
```
401
403
500
502
503
504
```
30
Rating of a hacked page
NJ: PDNL
31
Rating for Access Denied or Forbidden
NJ: PDNL
32
Rating for a URL that says "Product not Found"
NJ: PDNL
33
How do you rate it if http://www.daum.net/7437.php URL takes you to http://status.daum.net/error/error404.html and the last URL is in a foreign language?
NJ: PDNL
You can tell from the URL that it is a 404 errof
34
Rating for
Internal Server Error
NJ: PDNL
35
Rating for:
Temporary server error or application crash
NJ: PDNL
36
Rating for a page with nothing there except construction notice, or page coming soon notice.
NJ: PDNL
37
What two factors must be present to rate NJ: Login
1. Content of page is restricted to registered (and you are not registered).
AND
2. You are unable to determine relevance of the page without logging in.
38
Before assigning NJ: Login always check what?
Check the URL of the page.
39
What are the two criteria to rate a page
| NJ: Foreign?
1. You do not understand enough of the content on the landing page to make a judgment
AND
You believe the user COULD understand it.
40
What should you keep in mind before rating a page NJ: Foreign
You can often determine relevance even if you cannot read the content of the page
41
Generally, which language are users looking for results in?
Their target language.
However, not always.
Sometime the user intends to find foreign results.
42
Should you rate all foreign LP's as NJ: Foreign?
No. Be absolutely certain you are unable to determine relevance.
43
If a landing page is foreign and the query does not indicate any foreign intent, how should you rate the page?
BAD
44
When are three types of queries that may suggest the user expects or can use a foreign language?
1. When the query is in a foreign language
e. g. "universidad de barcelona"
2. When the query asks for a foreign language
e. g. "Japanese newspaper"
3. When the query is very connected to a foreign language (much more than to the domestic one.)
e. g. Foreign actor who is not known in your target language / market
45
If there is no indication that the user speaks a different language, and it comes up in a different language, how to rate it?
BAD
Eg. Query "Tokyo Hotel"
URL shows hotel information in German
46
When evaluating a page with foreign content, ask yourself if the user's query indicated a desire for foreign content.
If they did, and you can't read the page what should the rating be?
NJ: Foreign
| well, I guess Unless you can tell relevance without reading it. Then rate otherwise, I guess
47
When evaluating a page with foreign content, ask yourself if the user's query indicated a desire for foreign content.
If they did not, what should the rating be?
Bad.
Page they can't read is not useful to them either.
48
What two things should you do before applying PDNL rating?
1. Refresh the page
| 2. Copy / past URL into a new browser window
49
What types of phrase would indicate a BAD rating instead of a NJ: PDNL?
- Site is CLOSED
- Content or video has been removed / deleted / expired
- Product or document is no longer available.
These indicate permanence. PDNL is for temporary states.
50
"Product no longer available" should be rated?
Bad.
Indicates permanence
51
"Product cannot be found" should be rated
NJ: PDNL
Indicates may be temporary. (heck just lost!)
52
"Product currently unavilable > when don't know when or if this item will be back in stock" should be rated?
BAD and time sensitives
If there is lots of information on the page (even though no transactional relevance now) can rate it higher. If no information, just rate BAD.
53
What are 3 types of misleading content?
1. Content which tries to falsely attract or hijack traffic
2. Content that is malicious or harmful to user's machine
3. Content that will sometimes masquerade as security software.
54
What are 6 classification of misleading content
```
1 Spam
2 Parke Domains
3 Frames
4 Proxies
5 Manual redirects
6 Rogue security software
```
55
What is Spam?
tries to trick search engines into thinking a site providing useful content when it doesn't.
56
What are two types of Spam pages
- content spam
- link spam
These are misleading content
57
How can you identify a frame?
Right click somewhere on page, click properties, and check URL.
If the URL is different from the page URL, it is a frame.
(sometimes the word "frame" shows up in main URL")
58
What are some well-known proxy sites?
```
Anonymouse
FilterSneak
Proxify
SlyUser
Vtunnel
```
59
If suspicious of a Proxy, what should you do?
Investigate the domain name.
60
If you suspect malware what should you do?
Close the window with CTRL+W
| Close IE with Alt +F4
61
Ask what with subpages?
How popular will the subpage be with users?
| How well does this subpage satisfy the users query?
62
If the query for a well known retailer shows a subpage that you think at least 25% of users searching for that retailer will be looking for, it may be
it may be Excellent.
(Strongly satisfies very likely intent
63
Ask what with subpages?
How popular will the subpage be with users?
| How well does this subpage satisfy the users query?
64
If the query for a well known retailer shows a subpage that you think at least 25% of users searching for that retailer will be looking for, it may be
it may be Excellent.
(Strongly satisfies very likely intent
65
What are example for an Excellent and a Fair Jeep subpage
Excellent -- entire Jeep lineup
Fair -- Grand Cherokee only (Too narrow. Only weakly satisfies the most likely intent.
66
That Financial TImes (FT) site with a paywall required to see the article would be rated as ?
NJ: Login
Exception would be if you have an FT account and can see the page to assess its relevance.
67
Two examples when you would NOT use NJ: Login when you see a login page are:
?
- It is obvious the user would not want this page
- The user had asked for this login page
(Also, if you have an account and can see past the login page, so can see if it is relevant.)
68
When would you rate a login page as perfect?
When the user has asked for the login for this site.
69
If you can see the title and abstract (summary) for an article for which login is required, how should you rate it?
For relevance. Rate it according to the title and summary, if you can.
70
What should you always do when you see a login page?
Check the requested URL (the one you are being asked to rate.) So you can see if the login page is the requested URL, or if you ahve been redirected to a login page because you cannot view the original URL without logging in.
If a login page is between you and the requested URL, you might rate as NJ: Login .
71
How would you rate this:
Query: Bebo John Taylor
URL: http://www.bebo.com/SignIn.jsp
Bad.
URL itself is actual login page.
We can actually see the URL to be rated, and it is wrong / bad.
It's not just that the URL we want is hidden behind login page.
72
If page is in foreign language for my market AND there is indication that User has foreign language attempt what is the rating?
NJ: Foreign
73
What two conditions together would give a NJ: Foreign rating?
Foreign language LP
AND
Indication of User foreign language intent
74
If query is "Eduaro Noriega biografia" and the LP is in Spanish, what is the rating and why?
Rating is NJ Foreign, because
1) is foreign to my market
AND
2) is indication that the User actually wanted foreign language result
(So, it may be a good page for the user, but I can't rate it. So, NJ)
75
If we think a foreign language page may be useful to the user but we can't read it due to the language so we can't determine how much, how should we rate it?
NJ: Foreign
76
If a Query for Hotels in Tokyo came up in German language, how we we rate it?
BAD.
Foreign language
BUT
No foreign language intent
77
If you have an Query for an International company like Fiat or Volvo, and you're rating the URL for the Official home page, what should you do?
Check to see if there is a home page for that market. For example, is there a US home page for Volvo. If there is, then the US home page is the Perfect choice and the International one is Excellent. If there is not a local home page, then the International one is Perfect.
(Can just type the company name into Google to see if there is a local one)
78
When can a International or market neutral official home page receive a Perfect rating?
If no official site for your market/location exists.
To verify, do a side search.
79
How would you rate the following Foreign Queries?
Query: "MSN Japan"
URL: http://jp.msn.com
Query: "Italian Google"
URL: www.google.it
Query: vkontakte.ru
URL: http://vkontakte.ru
Query: Le Monde"
URL: httpL//www.lemonde.fr
Perfect
Even though you can't read the language, you can tell exact what it is.
80
What will find the next occurrence of a found word on page?
F3
or
Ctrl + G
81
What four questions should be considered to understand relationship to user intent?
1. Intent
2. Scope
3. Authority
4. Quality
82
How do you evaluate INTENT?
- Check whether and where terms appear in the LP title, content, and URL; note that a page can still be highly relevant even if they don’t.
- Compare the NATURE of the query with the LP; for example, a Wikipedia page on hiking boots does not address a possible intent for a user searching for {cheap hiking boots}, even though all the words of the query may appear on the page.
- URL can give additional information to help determine a rating.
83
What are three common characteristics of Excellent pages?
1. Popular, credible source of information
2. Robust content
3. Strong intent (but not dominant enough to justify a Perfect)
84
Which would be rated Excellent for the Query "Insurance"
www.geico.com
OR
www.joeblowinsurance.com
Geico.
Popular crdible source of information.
85
For Query "MLS", both MLS.com and the homepage of the MLS soccer league are two very likely intents. Both pages have strong scope and authority. What is the rating?
Excellent,
because there is not a Most Likely intent for this query. Just Very Likely
86
Can a subpage ever have a Perfect rating?
Yes.
For example, if the Query was "walmart appliances" and the URL was the appliance page of Walmart, that would be rated perfect.
87
What is the rating for one of many landing pages that could adequately meet query intent?
Good.
E.g. if query is "play games online" a dozen home pages (or more) could be rated good. They are not particularly authoritative enough, to rate and excellent.
88
What rating would you not want on the first page of results, but you don't' want to eliminate it.
Fair
Weakly satisfying.
89
Rating for a page that is weakly relevant but does not adequately answer the query.
Fair
90
What are some common characteristics of the Fair rating?
Too narrow
Too broad
Lacks freshness
91
For the query "Wal-Mart", the URL for Walmart's laptop page would be rated what?
Fair
Too narrow. Only 1 - 10% (unlikely) users would want this page.
92
Query is for a software company. URL is for the Twitter page of that software company. What rating?
Fair.
Most users have intent to download software etc. This is unlikely intent.
93
Parked domains
Spam pages
Manual redirects
Malicious software (automatic download)
should be rated what?
Bad
94
Common characteristics of Bad
- Far too broad or narrow
- Lacks freshness when necessary
- Out of market when applicable
- Inappropriate Foreign language
95
Is market usually important for an informational query?
No.
However market can be important for transactional queryies such as buying car or insurance.
96
If you had an out of market result for a query with the intent to purchase insurance or a car, what should it be rated?
Bad.
Market is important for these.
97
Rating for Query "Madonna upcoming concerts"
URL -- listing for 2 years ago
Bad
98
Rating for
Query - "livestock"
URL - article on foot rot in goat
Bad
Far too narrow
99
Does the detrimental rating apply to queries or landing pages?
Landing pages only
100
If a page has links to porn what should it be rated?
detrimental
101
What are some serious criminal activity that should be rated detrimental?
Promoting violence and murder
Human trafficking
Manufacture and sale of illegal narcotics
Violent racial, sexual, or religious crimes.
Hate speech
102
What is the rating for:
| Query: Facebook
LP: www.facebook.com
it's a login page
Perfect
It's clear that this is the page the user wants, even though it's a login page
103
What is the rating for:
| Query: citimortgae my account history
URL: www.citmortgage.com
It's a login page
NJ: Login
or, if you had a citimortgage account, you could log in and rate for relevance
104
How can you rate a page that is under construction?
Do a side search for existing site content.
105
Assign the NJ: Foreign rating for foreign language pages where I am unable to..
assess the relevance
106
Query : Kobe Bryant
| URL (wikipedia page for Kobe Bryant
Good
This robust page only satisfies a likely intent. More likely that user would be looking for current news, statistics and sports schedules
107
Rating for:
Query: verizon mail edit address book
URL (verizon sign in page)
NJ: Login
You are unable to view the relevant content without logging in
108
Rating for
Query: Justin Beiber
URL (a bit of gossip)
Fair
too narrow
Satisfies most likely intent weakly
109
In assessing authority to determine between excellent and good page, how do you know if a site is well-known or credible?
Do a side search
110
Between Hotels.com and TripAdvisor.com, which is more likely to be good and which more likely to be excellent
Hotels.com -- excellent. can book here
Tripadvisor - good. details obscure and can't book here.
111
If a page says "Inquire about this site" or something like that (often on the upper right or left) how should it be rated?
Bad
It is a parked domain
112
If you wonder how popular a site is, what is one way of finding out?
Look up Alexa rating
113
If you see a very strong page for one of 3 locations, how do you rate it?
Excellent.
1 of 3 people (33%) are looking for this location. So strong satisfying of very likely intent is Excellent.
114
If a common name (John Smith) a more satisfying page would be a page with
lots of choices -- perhaps with pictures and details.
115
10 or 15 people have that name.
Good
Moderately likely
116
If very common name and you get single person, the best you can get is
Fair,
An aggregate page is better.
117
If you find a single page for a person, and there are 4 - 20 people with that name how likely is it that this is the right person? (if there is no famous person or anything)
Moderately likely
118
What is Fair on the rating matrix?
- Weakly satisfies a most likely or very likely intent
- Moderately satisfies a likely intent
- Strongly satisfies and unlikely intent
119
What is Fair on the rating matrix?
- Weakly satisfies a most likely or very likely intent
- Moderately satisfies a likely intent
- Strongly satisfies and unlikely intent
120
What rating is a LP:
Useful to many users but most users wont' be completely satisfied and will keep on looking.
Typically one of many possible answers for a query.
Close match in terms of scope
Reasonably authoritative for average web user
Below the fold of first page, or on second page of results.
Goodd
121
Define a Good rating
- What rating is a LP USEFUL to many users but most users wont' be completely satisfied and will keep on looking.
- Typically ONE OF MANY possible answers for a query.
- CLOSE match in terms of scope
- REASONABLY AUTHORITATIVE for average web user
Below the fold of first page, or on second page of results.
122
What rating is:
- LP is related to query, but satisfies so weakly that is only useful to some users.
- Related to query but not really helpful or useful
- Too broad or too narrow for the query
- Questionable authoritativeness for average user
- Third or fourth page of web results
Fair
123
Define a Fair rating
- LP is related to query, but satisfies so weakly that is only useful to some users.
- Related to query but not really helpful or useful
- Too broad or too narrow for the query
- Questionable authoritativeness for average user
- Third or fourth page of web results
124
Where would one expect to find a Good rating on a search page?
Below the fold of first page,
or
on second page
125
Where would one expect to find a Fair rating on a search page?
3rd or 4th page
126
What would be the following rating:
- May completely miss the requirements in scope, freshness, authority, market, or language
- So little relation to query that will be useful to almost no users
- LP misses something that user specifically asked for
- Wayyyy to broad or narrow
- User asks why search engine even showed this up
- Query terms may be on page, but not related
- Outdated when timeliness matters
Bad
127
Define Bad rating
- May completely MISS the requirements in scope, freshness, authority, market, or language
- So little relation to query that will be useful to almost NO USERS
- LP MISSES something that user specifically asked for
- Wayyyy to broad or narrow
- User asks WHY search engine even showed this up
- Query TERMmay be on page, but not related
- OUTDATED when timeliness matters
128
What rating would be:
- LP is related to teh query, but satisfies it so weakly that only useful to some users
- Still contains relevant information
- You can see why search engine returned it, even though it's pretty far out there.
FAIR
129
What are some common areas of disagreement between Good vs Fair?
- Subpages
- Shopping queries
- Recipes
- Long or complicated queries
- Technical queries
- Informational queries
- Forum results
130
Shopping: User knows what they want
| I assume query is specific for some shopping item
- Rate based on specifics of the query
- How closely does it match?
- Is this close enough, or is it missing an essential element?
- Would you keep looking?
131
Shopping: User doesn't know exactly what they want
| I assume is a broad query
- More selection is better
- The more well-known the site the better
- Auctions are okay, as long as it is useful page
-
132
Rating for:
Query: Lasagna Recipes
URL: httpL//www.food.com/recipe-finder/all/lasagna
Good
Many recipes, but perhaps unsure of authoritativeness of the site as these recipes can be submitted by users.
Helpful and robust content.
133
Rating for:
Query: Lasagna Recipes
LP (gourmet.com single recipe for mushroom lasagna)
Fair
Single recipe. Common dish so more recipes to compare would be better.
Mushroom lasagna isn't probably what they are looking for
134
Rating for:
Query: Lasagna Recipes
LP: (Food Network listing of pasta recipes)
Bad
Authority is very good, but "pasta" does not satisfy the query
135
With homework query, does query question have to exactly match the landing page to be satisfying?
No
Matching context and meaning is okay
Look for context, relevance, and a meaningful answer to the query.
136
If query was for a long quote and the LP showed the quote and author from a non-authoritative source, what is the rating?
Good
137
If query was for a long quote and the LP showed the quote but no source/author what is the rating?
Fair
138
If query was for a long quote and the LP did not show the quote what is the rating?
Bad
139
If query is "What was Kristallnacht" and the LP adddress why Kristallnacht occurred but does not explain what occurred, what is the rating?
Bad
140
With Technical queries, what should you look for?
Look for keywords or essential elements
Model numbers
Operating systems
Things that much match in order to be considered helpful
141
Query about virus on external drive.
| LP is answer. Content generated.
Good
Has answer, but is of unknown authority
142
Query about virus on external drive.
| LP is answer. Content generated. Information is brief and is buried in page
Fair
143
Query about virus on external drive.
| LP is about viruses and mother boards
Bad
144
Query: Macy's.com
Which would be unlikely intent (1-10%)
and which would be very unlikely intent (<1%)
Lacoste Monaco Beach Towel
Gift card subpage
Unlkely - Gift card subpage
Very unlikely - Lacoste Monaco Beach Towel
145
Query: iPod
Which would be unlikely intent (1-10%)
and which would be very unlikely intent (<1%)
Replacement power cord
Support information
unlikely - Support information
very unlikely - Replacement power cord
146
Query: Seattle
Which would be unlikely intent (1-10%)
and which would be very unlikely intent (<1%)
Hotel information for Seattle
Cost of cab fare from airport in Seattle
unlikely - Hotel information for Seattle
very unlikely - Cost of cab fare from airport in Seattle
147
Query: Macys
Which would be unlikely intent (1-10%)
and which would be very unlikely intent (s Shoe Dept
One individual pair of shoes
unlikely - Macy's Shoe Dept
very unlikely - One individual pair of shoes
148
Query:
Which would be unlikely intent (1-10%)
and which would be very unlikely intent (<1%)
One individual pair of shoes
Jewelry department
unlikely - One individual pair of shoes
very unlikely - Jewelry department
149
Query for Katy Perry
Which would be unlikely intent (1-10%)
and which would be very unlikely intent (<1%)
A facebook profile for a Katie Parry
A single video for one of her songs
unlikely - A single video for one of her songs
very unlikely A facebook profile for a Katie Parry
150
What are 3 main types of detrimental content?
1) graphic sexuality
2) serious criminal activity
3) other shocking/offensive content
151
If the detrimental content is not a focus of the page so that most users wouldn't not notice or be offended, how should one rate?
Rate for relevance.
152
LP for torrents to porn would be rated?
Detrimental
153
LP for page with links to escort services would be rated?
Detrimental
154
If a site is a gateway to a detrimental site it should be rated how?
Detrimental
155
Murder, rate, hate crimes, sell or use of seriously ilicent drugs rated
Detrimental
156
For profanity to be rated detrimental it must be ...
extremely foul or graphic
157
Is the detrimental rating to filter for children?
No
Is unsuitable for general audience of adults
158
If something is not shocking but is for adults only, or restricted audience, rate how
for relevance
159
Which of the following are detrimental:
- Pornographic film
- Video of non-explicit movie sex scene
- Picture of topless woman
- Information about buying and using heroin
- Image of naked man
- White supremacist site advocating violence against minorities
Detrimental:
- Pornographic film
- Picture of topless woman
- Information about buying and using heroin
- Image of naked man
- White supremacist site advocating violence against minorities
Non-Detrimental
- -Video of non-explicit movie sex scene
-Before and after pictures of breast implant patients
- Information about the effects of heroin use
- Renaissance painting of a male nude
Historical text with racial hate speech
160
What is it important to do when you first see a name query?
Do a side search.
They may be famous -- even if you have not heard of them.
161
What resources can one use in side searches to find out how common a name is?
Facebook
LinkedIn
Phone and people directories
162
If a women clothing subpage comes up for a retailer (like Bananna Republic) known for selling women's clothing, what might the rating be.
Excellent
163
If a small men's wallet subpage comes up for a retailer known for selling women's clothing, what might the rating be?
Fair
164
For the query Jeep.com, what would the rating be for the subpage of the entire Jeep lineup?
Excellent
165
For the query jeep.com, what would the rating be for a subpage of a single Jeep vehicle?
Fair
166
Query: AVG free edition
avg homepage
avg Download page
Which is perfect and which is excellent?
Download page is perfect
Homepage is excellent
167
If software download query, what is old version download page rated?
Bad
168
If software download query, what is credibility uncertain page rated even if it has the latest software?
Fair
169
If Quert is for a game what is the rating for a mirror of the Official entry page
Perfect
