Persona:
Martínez Huertas, José Ángel

Cargando...
Foto de perfil
Dirección de correo electrónico
ORCID
0000-0002-6700-6832
Fecha de nacimiento
Proyectos de investigación
Unidades organizativas
Puesto de trabajo
Apellidos
Martínez Huertas
Nombre de pila
José Ángel
Nombre

Resultados de la búsqueda

Mostrando 1 - 10 de 14
  • Publicación
    Enhancing topic-detection in computerized assessments of constructed responses with distributional models of language
    (Elsevier, 2021-12-15) Olmos, Ricardo; León, José A.; Martínez Huertas, José Ángel
    Usually, computerized assessments of constructed responses use a predictive-centered approach instead of a validity-centered one. Here, we compared the convergent and discriminant validity of two computerized assessment methods designed to detect semantic topics in constructed responses: Inbuilt Rubric (IR) and Partial Contents Similarity (PCS). While both methods are distributional models of language and use the same Latent Semantic Analysis (LSA) prior knowledge, they produce different semantic representations. PCS evaluates constructed responses using non-meaningful semantic dimensions (this method is the standard LSA assessment of constructed responses), but IR endows original LSA semantic space coordinates with meaning. In the present study, 255 undergraduate and high school students were allocated one of three texts and were tasked to make a summary. A topic- detection task was conducted comparing IR and PCS methods. Evidence from convergent and discriminant validity was found in favor of the IR method for topic-detection in computerized constructed response assessments. In this line, the multicollinearity of PCS method was larger than the one of IR method, which means that the former is less capable of discriminating between related concepts or meanings. Moreover, the semantic representations of both methods were qualitatively different, that is, they evaluated different concepts or meanings. The implications of these automated assessment methods are also discussed. First, the meaningful coordinates of the Inbuilt Rubric method can accommodate expert rubrics for computerized assessments of constructed responses improving computer-assisted language learning. Second, they can provide high-quality computerized feedback accurately detecting topics in other educational constructed response assessments. Thus, it is concluded that: (1) IR method can represent different concepts and contents of a text, simultaneously mapping a considerable variability of contents in constructed responses; (2) IR method semantic representations have a qualitatively different meaning than the LSA ones and present a desirable multicollinearity that promotes the discriminant validity of the scores of distributional models of language; and (3) IR method can extend the performance and the applications of current LSA semantic representations by endowing the dimensions of the semantic space with semantic meanings.
  • Publicación
    Can personality traits be measured analyzing written language? A meta-analytic study on computational methods
    (Elsevier, 2021) Moreno, José David; Olmos, Ricardo; Jorge Botana, Guillermo de; Botella, Juan; Martínez Huertas, José Ángel
    In the last two decades, empirical evidence has shown that personality traits could be related to the characteristics of written language. This study describes a meta-analysis that synthesizes 23 independent estimates of the correlations between the Big Five major personality traits, and some computationally obtained indicators from written language. The results show significant combined estimates of the correlations, albeit small to moderate according to Cohen’s conventions to interpret effect sizes, for the five traits (between r = 0.26 for agreeableness and neuroticism, and 0.30 for openness). These estimates are moderated by the type of information in the texts, the use of prediction mechanisms, and the source of publication of the primary studies. Generally, the same effective moderators operate for the five traits. It is concluded that written language analyzed through computational methods could be used to extract relevant information of personality. But further research is still needed to consider it as predictive or explanatory tool for individual differences.
  • Publicación
    Recovering Crossed Random Effects in Mixed-Effects Models Using Model Averaging
    (PsychOpen, 2022-12-22) Olmos, Ricardo; Martínez Huertas, José Ángel
    Random effects contain crucial information to understand the variability of the processes under study in mixed-effects models with crossed random effects (MEMs-CR). Given that model selection makes all-or-nothing decisions regarding to the inclusion of model parameters, we evaluated if model averaging could deal with model uncertainty to recover random effects of MEMs-CR. Specifically, we analyzed the bias and the root mean squared error (RMSE) of the estimations of the variances of random effects using model averaging with Akaike weights and Bayesian model averaging with BIC posterior probabilities, comparing them with two alternative analytical strategies as benchmarks: AIC and BIC model selection, and fitting a full random structure. A simulation study was conducted manipulating sample sizes for subjects and items, and the variance of random effects. Results showed that model averaging, especially Akaike weights, can adequately recover random variances, given a minimum sample size in the modeled clusters. Thus, we endorse using model averaging to deal with model uncertainty in MEMs-CR. An empirical illustration is provided to ease the usability of model averaging.
  • Publicación
    Redundancy, Isomorphism and Propagative Mechanisms between Emotional and Amodal Representations of Words: A Computational Study
    (['Springer', 'Psychonomic Society'], 2020-08-20) Jorge Botana, Guillermo de; Olmos, Ricardo; Martínez Huertas, José Ángel; Luzón Encabo, José María
    Some proposals claim that language acts as a link to propagate emotional and other modal information. Thus, there is an eminently amodal path of emotional propagation in the mental lexicon. Following these proposals, we present a computational model that emulates a linking mechanism (mapping function) between emotional and amodal representations of words using vector space models, emotional feature-based models, and neural networks. We analyzed three central concepts within the embodiment debate (redundancy, isomorphism, and propagative mechanisms) comparing two alternative hypotheses: semantic neighborhood hypothesis vs. specific dimensionality hypothesis. Univariate and multivariate neural networks were trained for dimensional (N=11,357) and discrete emotions (N=2,266), and later we analyzed its predictions in a test set (N=4,167 and N=875, respectively). We showed how this computational model could propagate emotional responses to words without a direct emotional experience via amodal propagation, but no direct relations were found between emotional rates and amodal distances. Thereby, we found that there were clear redundancy and propagative mechanisms, but no isomorphism should be assumed. Results suggested that it was necessary to establish complex links to go beyond amodal distances of vector spaces. In this way, although the emotional rates of semantic neighborhoods could predict the emotional rates of target words, the mapping function of specific amodal features seemed to simulate emotional responses better. Thus, both hypotheses would not be mutually exclusive. We also showed that discrete emotions could have simpler relations between modal and amodal representations than dimensional emotions. All these results and their theoretical implications are discussed.
  • Publicación
    Model Selection and Model Averaging for Mixed-Effects Models with Crossed Random Effects for Subjects and Items
    (['Taylor and Francis Group', 'Routledge'], 2021-02-26) Olmos, Ricardo; Ferrer, Emilio; Martínez Huertas, José Ángel
    A good deal of experimental research is characterized by the presence of random effects on subjects and items. A standard modeling approach that includes such sources of variability is the mixed-effects models (MEMs) with crossed random effects. However, under-parameterizing or over-parameterizing the random structure of MEMs bias the estimations of the Standard Errors (SEs) of fixed effects. In this simulation study, we examined two different but complementary perspectives: model selection with likelihood-ratio tests, AIC, and BIC; and model averaging with Akaike weights. Results showed that true model selection was constant across the different strategies examined (including ML and REML estimators). However, sample size and variance of random slopes were found to explain true model selection and SE bias of fixed effects. No relevant differences in SE bias were found for model selection and model averaging. Sample size and variance of random slopes interacted with the estimator to explain SE bias. Only the within-subjects effect showed significant underestimation of SEs with smaller number of items and larger item random slopes. SE bias was higher for ML than REML, but the variability of SE bias was the opposite. Such variability can be translated into high rates of unacceptable bias in many replications.
  • Publicación
    Emotional Valence Precedes Semantic Maturation of Words: A Longitudinal Computational Study of Early Verbal Emotional Anchoring
    (Wiley, 2021-07-19) Jorge Botana, Guillermo de; Olmos, Ricardo; Martínez Huertas, José Ángel
    We present a longitudinal computational study on the connection between emotional and amodal word representations from a developmental perspective. In this study, children's and adult word representations were generated using the latent semantic analysis (LSA) vector space model and Word Maturity methodology. Some children's word representations were used to set a mapping function between amodal and emotional word representations with a neural network model using ratings from 9-year-old children. The neural network was trained and validated in the child semantic space. Then, the resulting neural network was tested with adult word representations using ratings from an adult data set. Samples of 1210 and 5315 words were used in the child and the adult semantic spaces, respectively. Results suggested that the emotional valence of words can be predicted from amodal vector representations even at the child stage, and accurate emotional propagation was found in the adult word vector representations. In this way, different propagative processes were observed in the adult semantic space. These findings highlight a potential mechanism for early verbal emotional anchoring. Moreover, different multiple linear regression and mixed-effect models revealed moderation effects for the performance of the longitudinal computational model. First, words with early maturation and subsequent semantic definition promoted emotional propagation. Second, an interaction effect between age of acquisition and abstractness was found to explain model performance. The theoretical and methodological implications are discussed.
  • Publicación
    Quantum projections on conceptual subspaces: A deeper dive into methodological challenges and opportunities
    (SAGE, 2024) Martínez Mingo, Alejandro; Olmos, Ricardo; Jorge Botana, Guillermo; Martínez Huertas, José Ángel
    In alignment with the distributional hypothesis of language, the work “Quantum Projections on Conceptual Subspaces” (Martínez-Mingo A, Jorge-Botana G, Martinez-Huertas JÁ, et al. Quantum projections on conceptual subspaces. Cogn Syst Res 2023; 82: 101154) proposed a methodology for generating conceptual subspaces from textual information based on previous work (Martinez-Mingo A, Jorge-Botana G and Olmos R. Quantum approach for similarity evaluation in LSA vector space models. 2020). These subspaces enable the utilization of the quantum model of similarity put forth by Pothos and Busemeyer (Pothos E, Busemeyer J. A quantum probability explanation for violations of symmetry in similarity judgments. In Proceedings of the annual meeting of the cognitive science society, 2011, Vol. 33, No. 33), allowing for the empirical examination of the violations of assumptions concerning symmetry and triangular inequality (Tversky A. Features of similarity. Psychol Rev 1977; 84: 327–352; Yearsley JM, Barque-Duran A, Scerrati E, et al. The triangle inequality constraint in similarity judgments. Prog Biophys Mol Biol 2017; 130: 26–32), as well as the diagnosticity effect (Tversky A. Features of similarity. Psychol Rev 1977; 84: 327–352; Yearsley JM, Pothos EM, Barque-Duran A, et al. Context effects in similarity judgments. J Exp Psychol Gen 2022; 151: 711–717), within a data-driven environment. These psychological biases, deeply studied by authors such as Tversky and Kahneman, inform us about the limitations of modeling psychological similarity measures using tools from classical geometry. This commentary aims to offer methodological clarifications, discuss theoretical and practical implications, and speculate on future directions in this field of research. Concretely, it aims to propose the use of different contours (conceptual or contextual) to generate the subspaces, which lead to subspaces of terms or contexts. Once these contours are defined, a differentiation is proposed between Aggregated Terms Subspaces (ATSs), Aggregated Contexts Subspaces (ACSs), and Aggregated Features Subspaces (AFSs) depending on whether we define the subspaces by grouping the terms or contexts within the contour, or from the latent dimensions of the semantic space obtained in the contour window. Finally, new data is provided on the violation of the triangular inequality assumption through the application of the quantum similarity model to ATSs.
  • Publicación
    Distilling vector space model scores for the assessment of constructed responses with bifactor Inbuilt Rubric method and latent variables
    (['Springer', 'Psychonomic Society'], 2022-01-11) Olmos, Ricardo; Jorge Botana, Guillermo de; León, José A.; Martínez Huertas, José Ángel
    In this paper, we highlight the importance of distilling the computational assessments of constructed responses to validate the indicators/proxies of constructs/trins using an empirical illustration in automated summary evaluation. We present the validation of the Inbuilt Rubric (IR) method that maps rubrics into vector spaces for concepts’ assessment. Specifically, we improved and validated its scores’ performance using latent variables, a common approach in psychometrics. We also validated a new hierarchical vector space, namely a bifactor IR. 205 Spanish undergraduate students produced 615 summaries of three different texts that were evaluated by human raters and different versions of the IR method using latent semantic analysis (LSA). The computational scores were validated using multiple linear regressions and different latent variable models like CFAs or SEMs. Convergent and discriminant validity was found for the IR scores using human rater scores as validity riteria. While this study was conducted in the Spanish language, the proposed scheme is language-independent and applicable to any language. We highlight four main conclusions: (1) Accurate performance can be observed in topic-detection tasks without hundreds/thousands of pre-scored samples required in supervised models. (2) Convergent/discriminant validity can be improved using measurement models for computational scores as they adjust for measurement errors. (3) Nouns embedded in fragments of instructional text can be an affordable alternative to use the IR method. (4) Hierarchical models, like the bifactor IR, can increase the validity of computational assessments evaluating general and specific knowledge in vector space models. R code is provided to apply the classic and bifactor IR method.
  • Publicación
    The processes of stress and coping in informal caregivers of people diagnosed on the schizophrenia spectrum. A longitudinal study
    (Fundación VECA para el Avance de la Psicología Clínica Conductual, 2023) Mora Castañeda, Belvy; Márquez González, María; Fernández Liria, Alberto; Cabrera, Isabel; Olmos, Ricardo; O'connell, Daniel; Martínez Huertas, José Ángel
    El objetivo de este estudio longitudinal fue analizar el papel del estrés y las estrategias de afrontamiento en la explicación de la carga y la depresión de familiares cuidadores de personas con diagnóstico del espectro de la esquizofrenia. Fueron evaluados 30 pacientes este diagnóstico y sus cuidadores informales (n=30). Los participantes fueron evaluados en tres momentos temporales: línea base, a los 5 meses y a los 10 meses. Se encontró una disminución de los niveles de carga subjetiva con el paso del tiempo. Asimismo, la carga subjetiva y la depresión del cuidador mostraron una mayor relación con aquellas variables del paciente relacionadas con la sintomatología negativa. A nivel longitudinal, la evitación y la resignación mostraron una notable relación con la carga subjetiva y la depresión. Los posibles cambios en la evaluación de las demandas que el trastorno plantea y en las estrategias de afrontamiento empleadas por los cuidadores sugieren el desarrollo de un proceso de adaptación al trastorno por parte del cuidador.
  • Publicación
    Modeling personality language use with small semantic vector subspaces
    (Elsevier, 2024-12-14) Jorge Botana, Guillermo de; Martínez Mingo, Alejandro; Olmos, Ricardo; Martínez Huertas, José Ángel; Moreno Salinas, David