000 03680nam a22003975i 4500
999 _c387449
_d387449
001 387449
003 ES-MaUEC
005 20230401115145.0
006 a||||fo|||| 00| 0
007 cr nn 008mamaa
008 230401s2011 sz | s |||| 0|eng d
020 _a9783031022760
024 7 _a10.1007/978-3-031-02276-0
_2doi
040 _aES-MaUEC
_bspa
_cES-MaUEC
_dES-MaUEC
050 4 _aZA3075
_b2011 EB
100 1 _aHarman, D. K.
_eautor
_4aut
_4http://id.loc.gov/vocabulary/relators/aut
_9687946
_q(Donna K.)
245 1 0 _aInformation Retrieval Evaluation
_cby Donna Harman
250 _a1st edition 2011
264 1 _aCham
_bSpringer International Publishing
_c2011
300 _a1 recurso en línea (XI, 107 páginas)
336 _atexto
_btxt
_2rdacontent
337 _aelectrónico
_bc
_2rdamedia
338 _arecurso electrónico
_bcr
_2rdacarrier
347 _aarchivo de texto
_bPDF
490 0 _aSynthesis Lectures on Information Concepts Retrieval and Services
_x1947-9468
505 0 _aIntroduction and Early History -- "Batch" Evaluation Since 1992 -- Interactive Evaluation -- Conclusion.
520 _aEvaluation has always played a major role in information retrieval, with the early pioneers such as Cyril Cleverdon and Gerard Salton laying the foundations for most of the evaluation methodologies in use today. The retrieval community has been extremely fortunate to have such a well-grounded evaluation paradigm during a period when most of the human language technologies were just developing. This lecture has the goal of explaining where these evaluation methodologies came from and how they have continued to adapt to the vastly changed environment in the search engine world today. The lecture starts with a discussion of the early evaluation of information retrieval systems, starting with the Cranfield testing in the early 1960s, continuing with the Lancaster "user" study for MEDLARS, and presenting the various test collection investigations by the SMART project and by groups in Britain. The emphasis in this chapter is on the how and the why of the various methodologies developed. The second chapter covers the more recent "batch" evaluations, examining the methodologies used in the various open evaluation campaigns such as TREC, NTCIR (emphasis on Asian languages), CLEF (emphasis on European languages), INEX (emphasis on semi-structured data), etc. Here again the focus is on the how and why, and in particular on the evolving of the older evaluation methodologies to handle new information access techniques. This includes how the test collection techniques were modified and how the metrics were changed to better reflect operational environments. The final chapters look at evaluation issues in user studies -- the interactive part of information retrieval, including a look at the search log studies mainly done by the commercial search engines. Here the goal is to show, via case studies, how the high-level issues of experimental design affect the final evaluations. Table of Contents: Introduction and Early History / "Batch" Evaluation Since 1992 / Interactive Evaluation / Conclusion.
988 _aSynthesis Collection of Technology_2011
650 7 _2embne
_9147823
_aRecuperación de la información
776 0 8 _iPrinted edition:
_z9783031011481
776 0 8 _iPrinted edition:
_z9783031034046
856 4 0 _uhttps://go.openathens.net/redirector/universidadeuropea.es?url=https://doi.org/10.1007/978-3-031-02276-0
_zAcceso a este recurso digital (usuarios Universidad Europea de Madrid)
942 _2lcc
_cLE
998 _b04/2023
_dz
_eIG
_zSI