Publicación:
Automated summary evaluation with inbuilt rubric method: An alternative to constructed responses and multiple-choice tests assessments

Vista sencilla de ítem
dc.contributor.authorJastrzebska, Olga
dc.contributor.authorOlmos, Ricardo
dc.contributor.authorLeón, José A.
dc.contributor.authorMartínez Huertas, José Ángel
dc.date.accessioned2024-05-20T11:48:36Z
dc.date.available2024-05-20T11:48:36Z
dc.date.issued2019-02-09
dc.description.abstractAutomated Summary Evaluation is proposed as an alternative to rubrics and multiple-choice tests in knowledge assessment. Inbuilt rubric is a recent Latent Semantic Analysis (LSA) method that implements rubrics in an artificially-generated semantic space. It was compared with classical LSA’s cosine-based methods assessing knowledge in a within-subjects design regarding two validation sources: a comparison with the results of rubric scores and multiple-choice tests, and the sensitivity of predicting the academic level of the test-taker. Results showed a higher reliability for inbuilt rubric (from Pearson correlation coefficient .81 to .49) over the classical LSA method (from .61 to .34) and a higher sensitivity using binary logistic regressions and effect sizes to predict academic level. It is concluded that inbuilt rubric has a qualitatively higher reliability and validity than classical LSA methods in a way that is complementary to models based on semantic networks. Thus, it is concluded that new Automated Summary Evaluation approaches such as the inbuilt rubric method can be practical in terms of reliability and efficiency, and, thus, they can offer an affordable and valuable form of knowledge assessment in different educational levels.en
dc.description.versionversión final
dc.identifier.doihttps://doi.org/10.1080/02602938.2019.1570079
dc.identifier.issn0260-2938 eISSN 1469-297X
dc.identifier.urihttps://hdl.handle.net/20.500.14468/12581
dc.journal.issue7
dc.journal.titleAssessment & Evaluation in Higher Education
dc.journal.volume44
dc.language.isoen
dc.publisherTaylor and Francis Group
dc.relation.centerFacultad de Psicología
dc.relation.departmentMetodología de las Ciencias del Comportamiento
dc.rightsinfo:eu-repo/semantics/openAccess
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0
dc.subject.keywordsAutomated Summary Evalution
dc.subject.keywordsInbuilt Rubric
dc.subject.keywordsrubrics
dc.subject.keywordssummaries
dc.subject.keywordsmultiple-choice tests
dc.titleAutomated summary evaluation with inbuilt rubric method: An alternative to constructed responses and multiple-choice tests assessmentses
dc.typejournal articleen
dc.typeartículoes
dspace.entity.typePublication
relation.isAuthorOfPublicationca510876-0be8-438a-a565-ac5f8953fb78
relation.isAuthorOfPublication.latestForDiscoveryca510876-0be8-438a-a565-ac5f8953fb78
Archivos
Bloque original
Mostrando 1 - 1 de 1
Miniatura
Nombre:
Martinez-Huertas_JA_AutomatedSum.pdf
Tamaño:
313.92 KB
Formato:
Adobe Portable Document Format
Descargar
Colecciones
Artículos y papers