Hybrid-Memcached: A Novel Approach for Memcached Persistence Optimization With Hybrid Memory
Memcached is a widely adopted, high-performance, in-memory key-value object caching system utilized in data centers. Nonetheless, its data is stored in volatile DRAM, making the cached data susceptible to loss during system shutdowns. Consequently, cold restarts experience significant delays. Persis...
Saved in:
Published in | IEEE transactions on computers Vol. 73; no. 7; pp. 1866 - 1874 |
---|---|
Main Authors | , , , , , , |
Format | Journal Article |
Language | English |
Published |
New York
IEEE
01.07.2024
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Memcached is a widely adopted, high-performance, in-memory key-value object caching system utilized in data centers. Nonetheless, its data is stored in volatile DRAM, making the cached data susceptible to loss during system shutdowns. Consequently, cold restarts experience significant delays. Persistent memory is a byte-addressable, large-capacity, and non-volatility storage media, which can be employed to avoid the cold restart problem. However, deploying Memcached on persistent memory requires consideration of issues such as write endurance, asymmetric read/write latency and bandwidth, and write granularity of persistent memory. In this paper, we propose Hybrid-Memcached, an optimized Memcached framework based on a hybrid combination of DRAM and persistent memory. Hybrid-Memcached includes three key components: (1) a DRAM-based data aggregation buffer to avoid multiple fine-grained writes, which extends the write endurance of persistent memory, (2) a data-object alignment mechanism to avoid write amplification, and (3) a non-temporal store instruction-based writing strategy to improve the bandwidth utilization. We have implemented Hybrid-Memcached on the Intel Optane persistent memory. Several micros-benchmarks are designed to evaluate Hybrid-Memcached by varying read/write ratios, access distributions, and key-value item sizes. Additionally, we evaluated it with the YCSB benchmark, showing a 21.2% performance improvement for fully write-intensive workloads and 11.8% for read-write balanced workloads. |
---|---|
AbstractList | Memcached is a widely adopted, high-performance, in-memory key-value object caching system utilized in data centers. Nonetheless, its data is stored in volatile DRAM, making the cached data susceptible to loss during system shutdowns. Consequently, cold restarts experience significant delays. Persistent memory is a byte-addressable, large-capacity, and non-volatility storage media, which can be employed to avoid the cold restart problem. However, deploying Memcached on persistent memory requires consideration of issues such as write endurance, asymmetric read/write latency and bandwidth, and write granularity of persistent memory. In this paper, we propose Hybrid-Memcached, an optimized Memcached framework based on a hybrid combination of DRAM and persistent memory. Hybrid-Memcached includes three key components: (1) a DRAM-based data aggregation buffer to avoid multiple fine-grained writes, which extends the write endurance of persistent memory, (2) a data-object alignment mechanism to avoid write amplification, and (3) a non-temporal store instruction-based writing strategy to improve the bandwidth utilization. We have implemented Hybrid-Memcached on the Intel Optane persistent memory. Several micros-benchmarks are designed to evaluate Hybrid-Memcached by varying read/write ratios, access distributions, and key-value item sizes. Additionally, we evaluated it with the YCSB benchmark, showing a 21.2% performance improvement for fully write-intensive workloads and 11.8% for read-write balanced workloads. |
Author | Gong, Xiaoli Hong, Jingxuan Zhang, Jin Jiang, Zhang Li, Xianduo Peng, Tianxiang Li, Haoran |
Author_xml | – sequence: 1 givenname: Zhang orcidid: 0009-0008-0613-935X surname: Jiang fullname: Jiang, Zhang organization: Institute of Systems and Networks, College of Computer Science, Nankai University, Tianjin, China – sequence: 2 givenname: Xianduo orcidid: 0000-0002-8009-8911 surname: Li fullname: Li, Xianduo organization: Institute of Systems and Networks, College of Computer Science, Nankai University, Tianjin, China – sequence: 3 givenname: Tianxiang orcidid: 0009-0008-8894-8934 surname: Peng fullname: Peng, Tianxiang organization: Institute of Systems and Networks, College of Computer Science, Nankai University, Tianjin, China – sequence: 4 givenname: Haoran orcidid: 0000-0002-8518-5491 surname: Li fullname: Li, Haoran organization: Institute of Systems and Networks, College of Computer Science, Nankai University, Tianjin, China – sequence: 5 givenname: Jingxuan orcidid: 0009-0006-4003-1073 surname: Hong fullname: Hong, Jingxuan organization: Institute of Systems and Networks, College of Computer Science, Nankai University, Tianjin, China – sequence: 6 givenname: Jin orcidid: 0000-0001-9086-1178 surname: Zhang fullname: Zhang, Jin email: nkzhangjin@nankai.edu.cn organization: Institute of Systems and Networks, College of Computer Science, Nankai University, Tianjin, China – sequence: 7 givenname: Xiaoli orcidid: 0000-0002-9836-558X surname: Gong fullname: Gong, Xiaoli email: gongxiaoli@nankai.edu.cn organization: Institute of Systems and Networks, College of Computer Science, Nankai University, Tianjin, China |
BookMark | eNpNkM1LAzEQxYMo2FbPXjwEPG-b7914K4taoVoPFS9CSLMJTWk3a7IV6l_vli3iaWDm994b3hCc16G2ANxgNMYYycmyHBNE2JjSgpNcnoEB5jzPpOTiHAwQwkUmKUOXYJjSBiEkCJID8Dk7rKKvshe7M9qsbXUPp_A1fNstnDZNDN0OuhDh3x2-2Zh8am1tLFw0rd_5H936UMMP365hb3fEQzxcgQunt8len-YIvD8-LMtZNl88PZfTeWYIY222QjkyOGcFc44YSkilK6E5FrRAWnJn8hUlTlCGC55zRismCaW2crziSBNGR-Cu9-0e_trb1KpN2Me6i1QUCSExk1J21KSnTAwpRetUE_1Ox4PCSB0rVMtSHStUpwo7xW2v8Nbaf3SXLzCjv1KmbVY |
CODEN | ITCOB4 |
Cites_doi | 10.1145/1807128.1807152 10.1145/3093336.3037730 10.14778/2735479.2735483 10.1145/3318464.3389716 10.1145/2882903.2915251 10.1145/2814576.2814806 10.1145/1816038.1816014 10.1145/3492321.3519556 10.5555/2685048.2685095 10.1145/2678373.2665712 10.1145/3410463.3414625 10.1109/MICRO50266.2020.00049 |
ContentType | Journal Article |
Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024 |
Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024 |
DBID | 97E RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D |
DOI | 10.1109/TC.2024.3385279 |
DatabaseName | IEEE All-Society Periodicals Package (ASPP) 2005-present IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library Online CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional |
DatabaseTitleList | Technology Research Database |
Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library Online url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Engineering Computer Science |
EISSN | 1557-9956 |
EndPage | 1874 |
ExternalDocumentID | 10_1109_TC_2024_3385279 10492614 |
Genre | orig-research |
GrantInformation_xml | – fundername: Key Research and Development Program of Guangdong Province, China grantid: 2021B0101310002 – fundername: Natural Science Foundation of China grantid: 62172239; 62372254 funderid: 10.13039/501100001809 – fundername: Innovative Development Joint Fund Key Projects of Shandong NSF grantid: ZR2022LZH009; ZR2023LZH003 |
GroupedDBID | --Z -DZ -~X .55 .DC 0R~ 29I 3EH 3O- 4.4 5GY 5VS 6IK 85S 97E AAJGR AASAJ AAYOK ABFSI ABQJQ ACGFO ACIWK ACNCT AENEX AETEA AETIX AI. AIBXA AKJIK ALLEH ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 E.L EBS EJD F20 HZ~ H~9 IAAWW IBMZZ ICLAB IEDLZ IFIPE IFJZH IPLJI JAVBF LAI M43 MS~ MVM O9- OCL P2P PQQKQ RIA RIC RIE RIG RNI RNS RXW RZB TAE TN5 TWZ UHB UKR UPT VH1 X7M XJT XOL XZL YXB YYQ YZZ ZCG AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D |
ID | FETCH-LOGICAL-c244t-b070c17484ff2c322dad6a516380a95fc7b32f6341857543d49233edf5d50a243 |
IEDL.DBID | RIE |
ISSN | 0018-9340 |
IngestDate | Wed Sep 25 01:15:50 EDT 2024 Thu Sep 26 20:26:09 EDT 2024 Wed Sep 11 06:09:08 EDT 2024 |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 7 |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c244t-b070c17484ff2c322dad6a516380a95fc7b32f6341857543d49233edf5d50a243 |
ORCID | 0009-0006-4003-1073 0009-0008-0613-935X 0000-0002-8009-8911 0009-0008-8894-8934 0000-0002-8518-5491 0000-0001-9086-1178 0000-0002-9836-558X |
PQID | 3066914999 |
PQPubID | 85452 |
PageCount | 9 |
ParticipantIDs | crossref_primary_10_1109_TC_2024_3385279 ieee_primary_10492614 proquest_journals_3066914999 |
PublicationCentury | 2000 |
PublicationDate | 2024-07-01 |
PublicationDateYYYYMMDD | 2024-07-01 |
PublicationDate_xml | – month: 07 year: 2024 text: 2024-07-01 day: 01 |
PublicationDecade | 2020 |
PublicationPlace | New York |
PublicationPlace_xml | – name: New York |
PublicationTitle | IEEE transactions on computers |
PublicationTitleAbbrev | TC |
PublicationYear | 2024 |
Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
References | ref13 ref12 ref23 ref15 Nishtala (ref2) 2013 ref14 ref11 ref22 ref10 ref21 Yang (ref8) 2020 ref1 ref17 ref16 Marathe (ref20) 2017 ref19 ref18 ref7 ref9 ref4 ref3 ref6 ref5 |
References_xml | – ident: ref18 doi: 10.1145/1807128.1807152 – ident: ref19 doi: 10.1145/3093336.3037730 – ident: ref3 article-title: Memcached, a distributed memory object caching system – ident: ref10 article-title: Intel® Optane™ persistent memory – ident: ref5 doi: 10.14778/2735479.2735483 – ident: ref22 article-title: Intel® software development emulator – ident: ref6 doi: 10.1145/3318464.3389716 – ident: ref15 article-title: Lenovo pmem-memcached: Lenovo modifications to memcached for enhanced persistent memory support.” – ident: ref16 article-title: Memtier_benchmark: NoSQL redis and memcache traffic generation and benchmarking tool – ident: ref21 doi: 10.1145/2882903.2915251 – ident: ref23 doi: 10.1145/2814576.2814806 – ident: ref14 article-title: 3D XPoint™: A breakthrough in non-volatile memory technology – start-page: 169 volume-title: Proc. 18th USENIX Conf. File Storage Technol. (FAST’20) year: 2020 ident: ref8 article-title: An empirical guide to the behavior and use of scalable persistent memory contributor: fullname: Yang – ident: ref4 article-title: Twemcache, a memory caching technology used by Twitter.” – ident: ref11 doi: 10.1145/1816038.1816014 – ident: ref7 doi: 10.1145/3492321.3519556 – start-page: 385 volume-title: Proc. 10th USENIX Symp. Netw. Syst. Des. Implementation (NSDI’13) year: 2013 ident: ref2 article-title: Scaling memcache at Facebook contributor: fullname: Nishtala – ident: ref1 doi: 10.5555/2685048.2685095 – ident: ref12 doi: 10.1145/2678373.2665712 – ident: ref17 article-title: brianfrankcooper/YCSB: Yahoo! Cloud serving benchmark – ident: ref13 doi: 10.1145/3410463.3414625 – ident: ref9 doi: 10.1109/MICRO50266.2020.00049 – start-page: 4 volume-title: Proc. 9th USENIX Conf. Hot Top. Storage File Syst. (HotStorage’17) year: 2017 ident: ref20 article-title: Persistent memcached: Bringing legacy code to byte-addressable persistent memory contributor: fullname: Marathe |
SSID | ssj0006209 |
Score | 2.4563682 |
Snippet | Memcached is a widely adopted, high-performance, in-memory key-value object caching system utilized in data centers. Nonetheless, its data is stored in... |
SourceID | proquest crossref ieee |
SourceType | Aggregation Database Publisher |
StartPage | 1866 |
SubjectTerms | Aerospace electronics Bandwidth Benchmarks Data management Dynamic random access memory Endurance Hardware In-memory key-value database Intel Optane Media Memcached Memory management persistent memory Random access memory Slabs Workload Workloads |
Title | Hybrid-Memcached: A Novel Approach for Memcached Persistence Optimization With Hybrid Memory |
URI | https://ieeexplore.ieee.org/document/10492614 https://www.proquest.com/docview/3066914999/abstract/ |
Volume | 73 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3NS8MwFA-6kx6czonTKTl48NKZNOmXtzGUIWxeNtxBKG2SoshWmZ0w_3rfa9MxFMFboekj5H037_0eIVdMJZCvBdIRIsgcGbLESRT3nTADhocqMEpjv_No7A-n8mHmzWyzetkLY4wpi89MDx_Lu3ydqxX-KgMNR3g7HFu9GzK3atbamF2_rufgoMFCMovjw1l0MxlAIujKHqRjnotFW1suqJyp8ssQl97lvknG9b6qopK33qpIe-rrB2Tjvzd-SA5snEn7lWAckR2zaJFmPcOBWpVukf0tQMJj8jxcYweXMzJzhUjP-pb26Tj_NEDJgo9TiHLp5j3FCnqUFCBGH8H8zG1fJ316LV5oRQ6X58t1m0zv7yaDoWPnLzgKnH7hpGAOFEew0SxzFWi-TrSfeBjBsSTyMhWkws18gfg3gSeFRrA3YXTmaY8lrhQnpLHIF-aUUKNVxI0B7htfhoKniScUTw3LAg4BIOuQ65ol8XsFsxGX6QmL4skgRu7Flnsd0sYD3lpWnW2HdGsexlYPP2JIiPyIY1Z39sdn52QPqVcVuF3SKJYrcwFxRpFelvL1DeqTzh0 |
link.rule.ids | 315,786,790,802,27957,27958,55109 |
linkProvider | IEEE |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LS8NAEB5ED-rBR61Yn3vw4CV1k82j8SbFUh-Nl4g9CCHZ3aBIG9FU0F_vTLKRogjeAtlMlp13MvMNwDGXKeZrgWsJEeSW2-OplUrbt3o5MrwnAy0V9TuPIn94516NvbFpVq96YbTWVfGZ7tJl9S9fFXJGn8pQwwnejsZWL6Gj52HdrvVteP2mosNGHRYuN0g-uPA07mMq6LhdTMg8h8q25pxQNVXllymu_MtgHaJmZ3VZyXN3VmZd-fkDtPHfW9-ANRNpsvNaNDZhQU9bsN5McWBGqVuwOgdJuAUPww_q4bJGeiIJ61mdsXMWFe8aKRn4cYZxLvu-z6iGnmQFibFbNEAT09nJ7p_KR1aTo-XF60cb7gYXcX9omQkMlkS3X1oZGgRpE9xonjsSdV-lyk89iuF4Gnq5DDLh5L4gBJzAc4UiuDehVe4pj6eOK7ZhcVpM9Q4wrWRoa438177bE3aWekLameZ5YGMIyDtw0rAkeamBNpIqQeFhEvcT4l5iuNeBNh3w3LL6bDuw3_AwMZr4lmBK5Ic25XW7fzx2BMvDeHST3FxG13uwQm-q63H3YbF8nekDjDrK7LCStS_4V9Fz |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Hybrid-Memcached%3A+A+Novel+Approach+for+Memcached+Persistence+Optimization+With+Hybrid+Memory&rft.jtitle=IEEE+transactions+on+computers&rft.au=Jiang%2C+Zhang&rft.au=Li%2C+Xianduo&rft.au=Peng%2C+Tianxiang&rft.au=Li%2C+Haoran&rft.date=2024-07-01&rft.issn=0018-9340&rft.eissn=1557-9956&rft.volume=73&rft.issue=7&rft.spage=1866&rft.epage=1874&rft_id=info:doi/10.1109%2FTC.2024.3385279&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_TC_2024_3385279 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0018-9340&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0018-9340&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0018-9340&client=summon |