Publicación:
On bank assembly and block selection in multidimensional forced-choice adaptive assessments

Vista sencilla de ítem
dc.contributor.authorSorrel, Miguel A.
dc.contributor.authorAbad, Francisco
dc.contributor.authorSchames Kreitchmann, Rodrigo
dc.date.accessioned2024-05-20T11:48:47Z
dc.date.available2024-05-20T11:48:47Z
dc.date.issued2023-04-01
dc.description.abstractMultidimensional forced-choice (FC) questionnaires have been consistently found to reduce the effects of socially desirable responding and faking in non-cognitive assessments. Although FC has been considered problematic for providing ipsative scores under the classical test theory, IRT models enable the estimation of non-ipsative scores from FC responses. However, while some authors indicate that blocks composed of opposite-keyed items are necessary to retrieve normative scores, others suggest that these blocks may be less robust to faking, thus impairing the assessment validity. Accordingly, this article presents a simulation study to investigate whether it is possible to retrieve normative scores using only positively keyed items in pairwise FC computerized adaptive testing (CAT). Specifically, a simulation study addressed the effect of 1) different bank assembly (with a randomly assembled bank, an optimally assembled bank, and blocks assembled on-the-fly considering every possible pair of items), and 2) block selection rules (i.e., T, and Bayesian D and A-rules) over the estimate accuracy and ipsativity and overlap rates. Moreover, different questionnaire lengths (30 and 60) and trait structures (independent or positively correlated) were studied, and a non-adaptive questionnaire was included as baseline in each condition. In general, very good trait estimates were retrieved, despite using only positively keyed items. Although the best trait accuracy and lowest ipsativity were found using the Bayesian A-rule with questionnaires assembled on-the-fly, the T-rule under this method led to the worst results. This points out to the importance of considering both aspects when designing FC CAT.en
dc.description.versionversión final
dc.identifier.doihttps://doi.org/10.1177/00131644221087986
dc.identifier.issn0013-1644; eISSN: 1552-3888
dc.identifier.urihttps://hdl.handle.net/20.500.14468/12585
dc.journal.issue2
dc.journal.titleEducational and Psychological Measurement
dc.journal.volume83
dc.language.isoen
dc.publisherSAGE
dc.relation.centerFacultad de Psicología
dc.relation.departmentMetodología de las Ciencias del Comportamiento
dc.rightsAtribución-NoComercial-SinDerivadas 4.0 Internacional
dc.rightsinfo:eu-repo/semantics/openAccess
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0
dc.subject.keywordsforced-choice format
dc.subject.keywordsipsative data
dc.subject.keywordsmultidimensional IRT
dc.subject.keywordsadaptive testing
dc.subject.keywordsitem selection
dc.titleOn bank assembly and block selection in multidimensional forced-choice adaptive assessmentses
dc.typeartículoes
dc.typejournal articleen
dspace.entity.typePublication
relation.isAuthorOfPublicationf5f17927-c033-42e0-867c-3a658141ef26
relation.isAuthorOfPublication.latestForDiscoveryf5f17927-c033-42e0-867c-3a658141ef26
Archivos
Bloque original
Mostrando 1 - 1 de 1
Miniatura
Nombre:
SCHAMES_KREITCHMANN_Rodrigo_On_bank_assembly.pdf
Tamaño:
933.88 KB
Formato:
Adobe Portable Document Format
Descargar
Colecciones
Artículos y papers