Contrastive Learning for Sequential Recommendation

Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his historical inter-actions. Despite their success, we argue that these approaches usually rely on the sequential prediction task to optimi...

Full description

Saved in:
Bibliographic Details
Published inData engineering pp. 1259 - 1273
Main Authors Xie, Xu, Sun, Fei, Liu, Zhaoyang, Wu, Shiwen, Gao, Jinyang, Zhang, Jiandong, Ding, Bolin, Cui, Bin
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.01.2022
Subjects
Online AccessGet full text
ISSN2375-026X
DOI10.1109/ICDE53745.2022.00099

Cover

Loading…
Abstract Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his historical inter-actions. Despite their success, we argue that these approaches usually rely on the sequential prediction task to optimize the huge amounts of parameters. They usually suffer from the data sparsity problem, which makes it difficult for them to learn high-quality user representations. To tackle that, inspired by recent advances of contrastive learning techniques in the computer vision, we propose a novel multi-task framework called Contrastive Learning for Sequential Recommendation (CL4SRec). CL4SRec not only takes advantage of the traditional next item prediction task but also utilizes the contrastive learning framework to derive self-supervision signals from the original user behavior sequences. Therefore, it can extract more meaningful user patterns and further encode the user representations effectively. In addition, we propose three data augmentation approaches to construct self-supervision signals. Extensive experiments on four public datasets demonstrate that CL4SRec achieves state-of-the-art performance over existing baselines by inferring better user representations.
AbstractList Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his historical inter-actions. Despite their success, we argue that these approaches usually rely on the sequential prediction task to optimize the huge amounts of parameters. They usually suffer from the data sparsity problem, which makes it difficult for them to learn high-quality user representations. To tackle that, inspired by recent advances of contrastive learning techniques in the computer vision, we propose a novel multi-task framework called Contrastive Learning for Sequential Recommendation (CL4SRec). CL4SRec not only takes advantage of the traditional next item prediction task but also utilizes the contrastive learning framework to derive self-supervision signals from the original user behavior sequences. Therefore, it can extract more meaningful user patterns and further encode the user representations effectively. In addition, we propose three data augmentation approaches to construct self-supervision signals. Extensive experiments on four public datasets demonstrate that CL4SRec achieves state-of-the-art performance over existing baselines by inferring better user representations.
Author Xie, Xu
Sun, Fei
Zhang, Jiandong
Ding, Bolin
Wu, Shiwen
Gao, Jinyang
Liu, Zhaoyang
Cui, Bin
Author_xml – sequence: 1
  givenname: Xu
  surname: Xie
  fullname: Xie, Xu
  email: xu.xie@pku.edu.cn
  organization: School of Computer Science & Key Laboratory of High Confidence Software Technologies (MOE), Peking University
– sequence: 2
  givenname: Fei
  surname: Sun
  fullname: Sun, Fei
  email: ofey.sf@alibaba-inc.com
  organization: Alibaba Group,China
– sequence: 3
  givenname: Zhaoyang
  surname: Liu
  fullname: Liu, Zhaoyang
  email: chensong.zjd@taobao.com
  organization: Alibaba Group,China
– sequence: 4
  givenname: Shiwen
  surname: Wu
  fullname: Wu, Shiwen
  email: wushw.18@pku.edu.cn
  organization: School of Computer Science & Key Laboratory of High Confidence Software Technologies (MOE), Peking University
– sequence: 5
  givenname: Jinyang
  surname: Gao
  fullname: Gao, Jinyang
  email: jingmu.lzy@alibaba-inc.com
  organization: Alibaba Group,China
– sequence: 6
  givenname: Jiandong
  surname: Zhang
  fullname: Zhang, Jiandong
  email: jinyang.gjy@alibaba-inc.com
  organization: Alibaba Group,China
– sequence: 7
  givenname: Bolin
  surname: Ding
  fullname: Ding, Bolin
  email: bolin.ding@alibaba-inc.com
  organization: Alibaba Group,China
– sequence: 8
  givenname: Bin
  surname: Cui
  fullname: Cui, Bin
  email: bin.cui@pku.edu.cn
  organization: School of Computer Science & Key Laboratory of High Confidence Software Technologies (MOE), Peking University
BookMark eNotzM9Kw0AQgPFVFGxrn0APeYHE2dmdTeYosdVCQPAPeCubZCIrzUaTKPj2Inr6Lj--pTqJQxSlLjVkWgNf7cqbDZncUoaAmAEA85FaaufIQlEYPlYLNDmlgO7lTK2n6Q1-kdWaYKGwHOI8-mkOX5JU4scY4mvSDWPyKB-fEufgD8mDNEPfS2z9HIZ4rk47f5hk_d-Vet5unsq7tLq_3ZXXVRrQ8ZzWhhpuWxDQFsFi7g3llGPbcW2N087XzIZBC3SapBBsneMatRAVTduYlbr4-wYR2b-Poffj954LQw61-QG880aO
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IH
CBEJK
RIE
RIO
DOI 10.1109/ICDE53745.2022.00099
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan (POP) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP) 1998-present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISBN 1665408839
9781665408837
EISSN 2375-026X
EndPage 1273
ExternalDocumentID 9835621
Genre orig-research
GrantInformation_xml – fundername: National Natural Science Foundation of China
  grantid: 61832001
  funderid: 10.13039/501100001809
GroupedDBID 6IE
6IH
6IL
6IN
AAWTH
ABLEC
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
IJVOP
OCL
RIE
RIL
RIO
ID FETCH-LOGICAL-i269t-b35c9dd0e01420427a357572df9b43616ab993901e0f15e8e2d669b21e558cdc3
IEDL.DBID RIE
IngestDate Wed Aug 27 02:24:33 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i269t-b35c9dd0e01420427a357572df9b43616ab993901e0f15e8e2d669b21e558cdc3
PageCount 15
ParticipantIDs ieee_primary_9835621
PublicationCentury 2000
PublicationDate 2022-01-01
PublicationDateYYYYMMDD 2022-01-01
PublicationDate_xml – month: 01
  year: 2022
  text: 2022-01-01
  day: 01
PublicationDecade 2020
PublicationTitle Data engineering
PublicationTitleAbbrev ICDE
PublicationYear 2022
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0000941150
Score 2.6558657
Snippet Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his...
SourceID ieee
SourceType Publisher
StartPage 1259
SubjectTerms Behavioral sciences
Computer vision
Conferences
Contrastive Learning
Data engineering
Data mining
Data models
Deep Learning
Multitasking
Recom-mender Systems
Title Contrastive Learning for Sequential Recommendation
URI https://ieeexplore.ieee.org/document/9835621
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8JAEJ4gJ0-oYHxnDx4t0H3RPSMETTQmSsKN7NMYFQ2Wi7_e2W1BYzx4a3rZdh-d75vOfB_AOW6SgBvDZswGm3FniswwLjOtgmFea2RkSe3zVk6m_HomZg242PTCeO9T8Znvxsv0L9-92VVMlfUUwgUZu8a3kLhVvVqbfArSlAhu6u64vK96V8PLkWADLpAF0iTLGQVef3iopBAybsHNevCqcuS5uypN137-0mX879PtQOe7WY_cbcLQLjT8Yg9aa7cGUh_eNtAoRLXUH_H7RmpZ1UeCmJXcp3JqPOovJLLRVxynclrqwHQ8ehhOstoxIXuiUpU4zcIq5_oeiQ-NLhqaIRwbUBeU4UzmUhvEIwgBfD_kwheeOimVobkXorDOsn1oLt4W_gCItk45pGPaFIFLG4wYeMs4s5JRnXN3CO04BfP3ShRjXr_90d-3j2E7LkKVuziBZrlc-VOM5qU5S8v4BTdqn3A
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8JAEJ4QPOgJFYxve_Boge6r3TNCQIGYCAk3sq8ao4LBcvHXO9sWNMaDt6aXbffR-b7pfN8AXOMmSXFjmJCa1ITM6iTUlIlQyVRTpxQystztcyz6U3Y347MK3Gy1MM65vPjMNf1l_i_fLs3ap8paEuGC8KrxHe7FuIVaa5tRQaLi4U2pj4vasjXo3HY5jRlHHkhyY05v8fqji0oeRHo1GG2GL2pHXprrTDfN5y9nxv8-3z40vuV6wcM2EB1AxS0Oobbp1xCUx7cOxFtRrdSH_8IFpbHqU4CoNXjMC6rxsL8Gno--4ThFr6UGTHvdSacflj0TwmciZIYTzY20tu2Q-hDfR0NRBGQxsanUjIpIKI2IBEGAa6cRd4kjVgipSeQ4T4w19Aiqi-XCHUOgjJUWCZnSScqESTWPnaGMGkGJipg9gbqfgvl7YYsxL9_-9O_bV7Dbn4yG8-FgfH8Ge35BikzGOVSz1dpdYGzP9GW-pF-6k6K4
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=proceeding&rft.title=Data+engineering&rft.atitle=Contrastive+Learning+for+Sequential+Recommendation&rft.au=Xie%2C+Xu&rft.au=Sun%2C+Fei&rft.au=Liu%2C+Zhaoyang&rft.au=Wu%2C+Shiwen&rft.date=2022-01-01&rft.pub=IEEE&rft.eissn=2375-026X&rft.spage=1259&rft.epage=1273&rft_id=info:doi/10.1109%2FICDE53745.2022.00099&rft.externalDocID=9835621