On the performance investigation of a fast optical switches based optical high performance computing infrastructure

Optical networks based on fast optical switches (FOSes) could potentially solve the latency, bandwidth, cost and power consumption challenges in current electrical switches (ESes) based high performance computing (HPC) networks. In this work, we present a novel HPC network which employs distributed...

Full description

Saved in:
Bibliographic Details
Published inComputer networks (Amsterdam, Netherlands : 1999) Vol. 198; p. 108349
Main Authors Yan, Fulong, Meyer, Hugo, Yuan, Changshun, Xue, Xuwei, Pan, Bitao, Guo, Xiaotao, Calabretta, Nicola, Xie, Chongjin
Format Journal Article
LanguageEnglish
Published Amsterdam Elsevier B.V 24.10.2021
Elsevier Sequoia S.A
Subjects
Blades
Computation
Cost and power consumption
Fast optical switch
Fireflies
Flow control
High performance computing
Infrastructure
Molecular dynamics
Multiplexing
Network architecture
Network latency
Optical communication
Optical flow (image analysis)
Power consumption
Reconfiguration
Switches
Topology
Network architecture
Fast optical switch
Cost and power consumption
High performance computing
0000
1111
Online AccessGet full text

Cover

More Information
Summary:Optical networks based on fast optical switches (FOSes) could potentially solve the latency, bandwidth, cost and power consumption challenges in current electrical switches (ESes) based high performance computing (HPC) networks. In this work, we present a novel HPC network which employs distributed FOS interconnecting by removing ES (Firefly). In Firefly, Dragonfly topology is adopted for the inter-group connection of blades, while the intra-group connection of blades is implemented by FOS with fast optical flow control. The Firefly exploits the wavelength, space, and time switching domain with nanoseconds reconfiguration time of the FOS to achieve efficient statistical multiplexing operation. We numerically investigate the Firefly performance with real HPC traffic traces collected by running multiple computing applications in MareNostrum 3 HPC infrastructure with Leaf-Spine architecture. Compared with Leaf Spine architecture, results show that Firefly performs 62.4%, 54%, 68.6%, and 71.8% less latency for the applications Conjugate Gradient (CG), Multi-Grid (MG), Multiple Instruction Lattice Computation (MILC), and Miniature Molecular Dynamics (MINI_MD), respectively. Moreover, Firefly can save 56.4% cost and 65.7% power consumption, respectively, with respect to Leaf-Spine when both support around 10,000 blades.
ISSN:1389-1286
1872-7069
DOI:10.1016/j.comnet.2021.108349