TY - JOUR TI - Relevance criteria dynamics: A study of online news selection on SERPs AU - Chang, Yung-Sheng AU - Gwizdka, Jacek T2 - Proceedings of the Association for Information Science and Technology AB - A lab-based experiment was conducted to understand the multidimensional and dynamic changes in the use of relevance criteria on online news on search engine result pages (SERPs). Data from retrospective think-aloud (RTA) was first analyzed to investigate the criteria used when participants selected a search result on SERPs. The number and frequency of criteria used for relevance judgments were calculated. The criteria used on subsequent SERPs visits and on results at different ranks on SERPs were then analyzed to understand the differences in relevance criteria that were applied. The results showed that among the top six identified criteria, specific source and topicality were the two most often used relevance criteria. 59.6% of the times partic- ipants used a single criterion to make relevance judgment. Considering how criteria changed on subsequent visits to SERPs and on search results at different ranks, specific source was the most often used criterion initially but was then surpassed by topicality on subsequent visits to SERPs and on results at lower ranks. This could be explained by users using specific source as the primary cue in information evaluation and by users' expectation that Google's search engine algorithm shows more relevant information on the first SERP and at the top result ranks. DA - 2018/// PY - 2018 DO - 10.1002/pra2.2018.14505501108 DP - Wiley Online Library VL - 55 IS - 1 SP - 768 EP - 769 LA - en SN - 2373-9231 ST - Relevance criteria dynamics UR - http://asistdl.pericles.prod.literatumonline.com/doi/abs/10.1002/pra2.2018.14505501108 Y2 - 2019/09/30/18:54:48 KW - REMINDS_project KW - Relevance KW - Relevance criteria KW - SERP KW - Web search KW - mypub KW - z_IX_lab ER -