Publicación:
EvALL: Open Access Evaluation for Information Access Systems

Vista sencilla de ítem
dc.contributor.authorAlmagro Cádiz, Mario
dc.contributor.authorRodríguez Vidal, Javier
dc.contributor.authorVerdejo, Felisa
dc.contributor.authorAmigo Cabrera, Enrique
dc.contributor.authorCarrillo de Albornoz Cuadrado, Jorge Amando
dc.contributor.authorGonzalo Arroyo, Julio Antonio
dc.date.accessioned2024-05-20T11:43:52Z
dc.date.available2024-05-20T11:43:52Z
dc.date.issued2017
dc.description.abstractThe EvALL online evaluation service aims to provide a unified evaluation framework for Information Access systems that makes results completely comparable and publicly available for the whole research community. For researchers working on a given test collection, the framework allows to: (i) evaluate results in a way compliant with measurement theory and with state-of-the-art evaluation practices in the field; (ii) quantitatively and qualitatively compare their results with the state of the art; (iii) provide their results as reusable data to the scientific community; (iv) automatically generate evaluation figures and (low-level) interpretation of the results, both as a pdf report and as a latex source. For researchers running a challenge (a comparative evaluation campaign on shared data), the framework helps them to manage, store and evaluate submissions, and to preserve ground truth and system output data for future use by the research community. EvALL can be tested at http://evall.uned.es.en
dc.description.versionversión publicada
dc.identifier.urihttps://hdl.handle.net/20.500.14468/12478
dc.language.isoen
dc.publisherAssociation for Computing Machinery (ACM)
dc.relation.centerE.T.S. de Ingeniería Informática
dc.relation.departmentLenguajes y Sistemas Informáticos
dc.rightsAtribución-NoComercial-SinDerivadas 4.0 Internacional
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0
dc.subject.keywordsInformation Retrieval
dc.subject.keywordsInformation Access
dc.subject.keywordsEvaluation
dc.subject.keywordsEvaluation infrastructure
dc.subject.keywordsEvaluation Metrics
dc.titleEvALL: Open Access Evaluation for Information Access Systemses
dc.typeartículoes
dc.typejournal articleen
dspace.entity.typePublication
relation.isAuthorOfPublicationf96c6e59-3a7a-4b0c-9b10-deec22f8c06b
relation.isAuthorOfPublication53880f08-9d78-461b-9d10-89624a089b47
relation.isAuthorOfPublication0e0d6c85-2d8e-4fb3-9640-8ad17e875fcc
relation.isAuthorOfPublication.latestForDiscoveryf96c6e59-3a7a-4b0c-9b10-deec22f8c06b
Archivos
Bloque original
Mostrando 1 - 1 de 1
Miniatura
Nombre:
Rodriguez_Vidal_Javier_EvALL.pdf
Tamaño:
678.99 KB
Formato:
Adobe Portable Document Format
Descargar
Colecciones
Artículos y papers