EvALL: Open Access Evaluation for Information Access Systems

Amigó, Enrique, Carrillo de Albornoz, Jorge, Almagro Cádiz, Mario, Gonzalo, Julio, Rodríguez-Vidal, Javier y Verdejo, Felisa(2017) .EvALL: Open Access Evaluation for Information Access Systems. SIGIR '17: 40th International ACM SIGIR Conference on Research and Development in Information Retrieval.En: Tokyo, Japón. (2017-08-07)

Ficheros (Some files may be inaccessible until you login with your e-spacio credentials)
Nombre Descripción Tipo MIME Size
Rodriguez_Vidal_Javier_EvALL.pdf Rodriguez Vidal_Javier_EvALL.pdf application/pdf 678.99KB

Título de la Conferencia SIGIR '17: 40th International ACM SIGIR Conference on Research and Development in Information Retrieval
Fecha de inicio de la Conferencia 2017-08-07
Fecha fín de la Conferencia 2017-08-11
Lugar de la Conferencia Tokyo, Japón
Fecha de presentación de la Ponencia 2017-08-07
Numeros de las páginas 1301–1304
Titulo EvALL: Open Access Evaluation for Information Access Systems
Autor(es) Amigó, Enrique
Carrillo de Albornoz, Jorge
Almagro Cádiz, Mario
Gonzalo, Julio
Rodríguez-Vidal, Javier
Verdejo, Felisa
Notas adicionales Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. ISBN: 9781450350228
Materia(s) Informática
Abstract The EvALL online evaluation service aims to provide a unified evaluation framework for Information Access systems that makes results completely comparable and publicly available for the whole research community. For researchers working on a given test collection, the framework allows to: (i) evaluate results in a way compliant with measurement theory and with state-of-the-art evaluation practices in the field; (ii) quantitatively and qualitatively compare their results with the state of the art; (iii) provide their results as reusable data to the scientific community; (iv) automatically generate evaluation figures and (low-level) interpretation of the results, both as a pdf report and as a latex source. For researchers running a challenge (a comparative evaluation campaign on shared data), the framework helps them to manage, store and evaluate submissions, and to preserve ground truth and system output data for future use by the research community. EvALL can be tested at http://evall.uned.es.
Palabra clave Information Retrieval
Information Access
Evaluation
Evaluation infrastructure
Evaluation Metrics
Editor(es) Association for Computing Machinery (ACM)
Fecha 2017
Formato application/pdf
Identificador bibliuned:DptoLSI-ETSI-GPLNyRI-Jrodriguez-0006
http://e-spacio.uned.es/fez/view/bibliuned:DptoLSI-ETSI-GPLNyRI-Jrodriguez-0006
https://doi.org/10.1145/3077136.3084145
Total de paginas 4 p.
Idioma eng
Versión de la publicación publishedVersion
Nivel de acceso y licencia http://creativecommons.org/licenses/by-nc-nd/4.0
info:eu-repo/semantics/openAccess
Tipo de recurso conferenceObject
Tipo de acceso publishedVersion

 
Versiones
Versión Tipo de filtro
Contador de citas: Google Scholar Search Google Scholar
Estadísticas de acceso: 42 Visitas, 10 Descargas  -  Estadísticas en detalle
Creado: Fri, 26 Jan 2024, 23:23:22 CET