Large-Scale DAQ Tests for the LHCb Upgrade

• Published in: IEEE transactions on nuclear science Vol. 64; no. 6; pp. 1486 - 1493
• Main Authors: Manzali, Matteo, Falabella, Antonio, Giacomini, Francesco, Marconi, Umberto, Neufeld, Niko, Valat, Sebastien, Voneki, Balazs
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.06.2017; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Bandwidth; Bus interconnections; Cards; Clocks; Clusters; Computer programs; Computers; Data acquisition; Data acquisition (DAQ); Detectors; event building; Fragmentation; Fragments; Hardware; high-throughput computing; infiniBand; Large Hadron Collider; LHCb; Links; Protocol (computers); Protocols; Software
• ISSN: 0018-9499; 1558-1578
• DOI: 10.1109/TNS.2017.2693422

To increase the event yield, the LHCb experiment will undergo a major detector upgrade planned during the second long shutdown of the Large Hadron Collider (2019-2020). The new data acquisition has to process the whole 40-MHz input event rate, relying only on the large-scale computing farm implementation of the high-level trigger. Event fragments will be forwarded at 40 MHz from the detector front-end electronics to the event builder (EB), through optical links and peripheral component interconnect express cards. The EB farm, of about 500 computers, shall provide an aggregated throughput of 32 Tb/s. To reach the required EB performance, we are testing various interconnect technologies and network protocols on large-scale computing clusters. For this purpose, we have developed an EB software evaluator. We report here about the results of the measurements performed on high-performance computing facilities to test throughput and scalability.