Paoletti, Mercedes EugeniaMoreno Álvarez, SergioHaut, Juan M.2024-11-182024-11-182022M. E. Paoletti, S. Moreno-Álvarez and J. M. Haut, "Multiple Attention-Guided Capsule Networks for Hyperspectral Image Classification," in IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-20, 2022, Art no. 5520420, doi: 10.1109/TGRS.2021.31355060196-2892, eISSN: 1558-0644https://doi.org/10.1109/TGRS.2021.3135506https://hdl.handle.net/20.500.14468/24401The registered version of this article, first published in “IEEE Transactions on Geoscience and Remote Sensing, vol. 60, 2022", is available online at the publisher's website: IEEE, https://doi.org/10.1109/TGRS.2021.3135506 La versión registrada de este artículo, publicado por primera vez en “IEEE Transactions on Geoscience and Remote Sensing, vol. 60, 2022", está disponible en línea en el sitio web del editor: IEEE, https://doi.org/10.1109/TGRS.2021.3135506The profound impact of deep learning and particularly of convolutional neural networks (CNNs) in automatic image processing has been decisive for the progress and evolution of remote sensing (RS) hyperspectral imaging (HSI) processing. Indeed, CNNs have stated themselves as the current state of the art, reaching unparalleled results in HSI classification. However, most CNNs were designed for RGB images, and their direct application to HSI data analysis could lead to nonoptimal solutions. Moreover, CNNs perform classification based on the identification of specific features, neglecting the spatial relationships between different features (i.e., their arrangement) due to pooling techniques. The capsule network (CapsNet) architecture is an attempt to overcome this drawback by nesting several neural layers within a capsule, connected by dynamic routing, both to identify not only the presence of a feature but also its instantiation parameters and to learn the relationships between different features. Although this mechanism improves the data representations, enhancing the classification of HSI data, it still acts as a black box, without control of the most relevant features for classification purposes. Indeed, important features could be discriminated against. In this article, a new multiple attention-guided CapsNet is proposed to improve feature processing for RS-HSIs’ classification, both to improve computational efficiency (in terms of parameters) and increase accuracy. Hence, the most representative visual parts of the images are identified using a detailed feature extractor coupled with attention mechanisms. Extensive experimental results have been obtained on five real datasets, demonstrating the great potential of the proposed method compared to other state-of-the-art classifiers.eninfo:eu-repo/semantics/restrictedAccess12 Matemáticas::1203 Ciencia de los ordenadores ::1203.17 Informáticaartículoattentioncapsule network (CapsNet)convolutional neural network (CNN)featurehyperspectral imaging (HSI)