• Distributed Deep Learning: From Single-Node to Multi-Node ArchitecturePeer reviewedClosed access 

      2022, LERAT, Jean-Sébastien; Mahmoudi, Sidi Ahmed; Mahmoudi, Saïd, HE en Hainaut
      Article scientifique
      During the last years, deep learning (DL) models have been used in several applications with large datasets and complex models. These applications require methods to train models faster, such as distributed deep learning (DDL). This paper proposes an empirical approach aiming to measure the speedup of DDL achieved by using different parallelism strategies on the nodes. Local parallelism is considered ...