MemTunnel: a CXL-based Rack-Scale Host Memory Pooling Architecture for Cloud Service

Memory underutilization poses a significant challenge in cloud services, leading to performance inefficiencies and resource wastage. The tightly coupled computing and memory resources in cloud servers are identified as the root cause of this problem. To address this issue, memory pooling has been th...

Full description

Saved in:
Bibliographic Details
Published inIEEE transactions on parallel and distributed systems pp. 1 - 16
Main Authors Guan, Tianchan, Guan, Yijin, Du, Zhaoyang, Ma, Jiacheng, Tian, Boyu, Wang, Zhao, Ma, Teng, Liu, Zheng, Kong, Yang, Xie, Yuan, Gao, Mingyu, Sun, Guangyu, Zheng, Hongzhong, Niu, Dimin
Format Journal Article
LanguageEnglish
Published IEEE 2025
Subjects
Bandwidth
Cloud computing
CXL
Fabrics
Hardware
Memory architecture
memory disaggregation
Memory management
memory pool
Servers
Software architecture
Virtual machines
Online AccessGet full text

Cover

More Information
Summary:Memory underutilization poses a significant challenge in cloud services, leading to performance inefficiencies and resource wastage. The tightly coupled computing and memory resources in cloud servers are identified as the root cause of this problem. To address this issue, memory pooling has been the subject of extensive research for decades, providing centralized or distributed shared memory pools as flexible memory resources for various applications running on different servers. However, existing memory disaggregation solutions sacrifice memory resources, add extra hardware (such as memory boxes/blades/drives), and degrade memory performance to achieve flexibility. To overcome these limitations, this paper proposes MemTunnel, a rack-scale host memory pooling architecture that provides a low-cost memory pooling solution based on Compute Express Link (CXL). MemTunnel is the first hardware and software architecture to offer symmetric, memory-semantic memory pooling over CXL, with an FPGA-based platform to demonstrate its feasibility in a real implementation. MemTunnel is orthogonal to the existing CXL-based memory pool and provides an additional layer of abstraction for memory disaggregation. Evaluation results show that MemTunnel achieves comparable performance to the existing CXL-based memory pool for a single machine and provides better rack-scale performance with minor hardware overheads.
ISSN:1045-9219
1558-2183
DOI:10.1109/TPDS.2025.3598190