Understanding and Evaluating Search Experience by Maria Stone

Understanding and Evaluating Search Experience by Maria Stone

This book is intended for anyone interested in learning more about how search works and how it is evaluated. We all use search-it's a familiar utility. Yet, few of us stop and think about how search works, what makes search results good, and who, if anyone, decides what good looks like. Search has a long and glorious history, yet it continues to evolve, and with it, the measurement and our understanding of the kinds of experiences search can deliver continues to evolve, as well. We will discuss the basics of how search engines work, how humans use search engines, and how measurement works. Equipped with these general topics, we will then dive into the established ways of measuring search user experience, and their pros and cons. We will talk about collecting labels from human judges, analyzing usage logs, surveying end users, and even touch upon automated evaluation methods. After introducing different ways of collecting metrics, we will cover experimentation as it applies to search evaluation. The book will cover evaluating different aspects of search-from search user interface (UI), to results presentation, to the quality of search algorithms. In covering these topics, we will touch upon many issues in evaluation that became sources of controversy-from user privacy, to ethical considerations, to transparency, to potential for bias. We will conclude by contrasting measuring with understanding, and pondering the future of search evaluation.

Maria Stone spent years in different roles spanning user research and evaluative data science. Her search career spans two decades in Silicon Valley, where she worked for Alta Vista, Google, Yahoo, and Microsoft, as well as Apple Maps and Siri. Prior to her work in industry, she was an academic researcher and lecturer focused on studying human memory and attention, where she holds a Ph.D. in Cognitive Psychology from UC Berkeley and has authored publications in Cognitive Psychology, HCI, and Information Retrieval. She currently works for Spotify and resides in Stockholm.

SKU	Unavailable
ISBN 13	9783031792045
ISBN 10	3031792041
Title	Understanding and Evaluating Search Experience
Author	Maria Stone
Series	Synthesis Lectures On Information Concepts Retrieval And Services
Condition	Unavailable
Binding Type	Paperback
Publisher	Springer International Publishing AG
Year published	2022-03-28
Number of pages	87
Cover note	Book picture is for illustrative purposes only, actual binding, cover or edition may vary.