Publicación: Optimizing Distributed Deep Learning in Heterogeneous Computing Platforms for Remote Sensing Data Classification
Cargando...
Fecha
2022
Editor/a
Director/a
Tutor/a
Coordinador/a
Prologuista
Revisor/a
Ilustrador/a
Derechos de acceso
info:eu-repo/semantics/restrictedAccess
Título de la revista
ISSN de la revista
Título del volumen
Editor
IEEE
Resumen
Applications from Remote Sensing (RS) unveiled unique challenges to Deep Learning (DL) due to the high volume and complexity of their data. On the one hand, deep neural network architectures have the capability to automatically ex-tract informative features from RS data. On the other hand, these models have massive amounts of tunable parameters, re-quiring high computational capabilities. Distributed DL with data parallelism on High-Performance Computing (HPC) sys-tems have proved necessary in dealing with the demands of DL models. Nevertheless, a single HPC system can be al-ready highly heterogeneous and include different computing resources with uneven processing power. In this context, a standard data parallelism strategy does not partition the data efficiently according to the available computing resources. This paper proposes an alternative approach to compute the gradient, which guarantees that the contribution to the gradi-ent calculation is proportional to the processing speed of each DL model's replica. The experimental results are obtained in a heterogeneous HPC system with RS data and demon-strate that the proposed approach provides a significant training speed up and gain in the global accuracy compared to one of the state-of-the-art distributed DL framework.
Descripción
The registered version of this article, first published in “Institute of Electrical and Electronics Engineers Inc, 2022", is available online at the publisher's website: IEEE, https://doi.org/10.1109/IGARSS46834.2022.9883762
La versión registrada de este artículo, publicado por primera vez en “Institute of Electrical and Electronics Engineers Inc, 2022", está disponible en línea en el sitio web del editor: IEEE, https://doi.org/10.1109/IGARSS46834.2022.9883762
Categorías UNESCO
Palabras clave
training, deep learning, computational modeling, distributed databases, predictive models, parallel processing, feature extraction
Citación
S. Moreno-Álvarez, M. E. Paoletti, J. A. Rico, G. Cavallaro and J. M. Haut, "Optimizing Distributed Deep Learning in Heterogeneous Computing Platforms for Remote Sensing Data Classification," IGARSS 2022 - 2022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, Malaysia, 2022, pp. 2726-2729, doi: 10.1109/IGARSS46834.2022.9883762.
Centro
Facultades y escuelas::E.T.S. de Ingeniería Informática
Departamento
Lenguajes y Sistemas Informáticos