Contrastive Learning for Sequential Recommendation
Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his historical inter-actions. Despite their success, we argue that these approaches usually rely on the sequential prediction task to optimi...
Saved in:
Published in | Data engineering pp. 1259 - 1273 |
---|---|
Main Authors | , , , , , , , |
Format | Conference Proceeding |
Language | English |
Published |
IEEE
01.01.2022
|
Subjects | |
Online Access | Get full text |
ISSN | 2375-026X |
DOI | 10.1109/ICDE53745.2022.00099 |
Cover
Loading…
Abstract | Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his historical inter-actions. Despite their success, we argue that these approaches usually rely on the sequential prediction task to optimize the huge amounts of parameters. They usually suffer from the data sparsity problem, which makes it difficult for them to learn high-quality user representations. To tackle that, inspired by recent advances of contrastive learning techniques in the computer vision, we propose a novel multi-task framework called Contrastive Learning for Sequential Recommendation (CL4SRec). CL4SRec not only takes advantage of the traditional next item prediction task but also utilizes the contrastive learning framework to derive self-supervision signals from the original user behavior sequences. Therefore, it can extract more meaningful user patterns and further encode the user representations effectively. In addition, we propose three data augmentation approaches to construct self-supervision signals. Extensive experiments on four public datasets demonstrate that CL4SRec achieves state-of-the-art performance over existing baselines by inferring better user representations. |
---|---|
AbstractList | Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his historical inter-actions. Despite their success, we argue that these approaches usually rely on the sequential prediction task to optimize the huge amounts of parameters. They usually suffer from the data sparsity problem, which makes it difficult for them to learn high-quality user representations. To tackle that, inspired by recent advances of contrastive learning techniques in the computer vision, we propose a novel multi-task framework called Contrastive Learning for Sequential Recommendation (CL4SRec). CL4SRec not only takes advantage of the traditional next item prediction task but also utilizes the contrastive learning framework to derive self-supervision signals from the original user behavior sequences. Therefore, it can extract more meaningful user patterns and further encode the user representations effectively. In addition, we propose three data augmentation approaches to construct self-supervision signals. Extensive experiments on four public datasets demonstrate that CL4SRec achieves state-of-the-art performance over existing baselines by inferring better user representations. |
Author | Xie, Xu Sun, Fei Zhang, Jiandong Ding, Bolin Wu, Shiwen Gao, Jinyang Liu, Zhaoyang Cui, Bin |
Author_xml | – sequence: 1 givenname: Xu surname: Xie fullname: Xie, Xu email: xu.xie@pku.edu.cn organization: School of Computer Science & Key Laboratory of High Confidence Software Technologies (MOE), Peking University – sequence: 2 givenname: Fei surname: Sun fullname: Sun, Fei email: ofey.sf@alibaba-inc.com organization: Alibaba Group,China – sequence: 3 givenname: Zhaoyang surname: Liu fullname: Liu, Zhaoyang email: chensong.zjd@taobao.com organization: Alibaba Group,China – sequence: 4 givenname: Shiwen surname: Wu fullname: Wu, Shiwen email: wushw.18@pku.edu.cn organization: School of Computer Science & Key Laboratory of High Confidence Software Technologies (MOE), Peking University – sequence: 5 givenname: Jinyang surname: Gao fullname: Gao, Jinyang email: jingmu.lzy@alibaba-inc.com organization: Alibaba Group,China – sequence: 6 givenname: Jiandong surname: Zhang fullname: Zhang, Jiandong email: jinyang.gjy@alibaba-inc.com organization: Alibaba Group,China – sequence: 7 givenname: Bolin surname: Ding fullname: Ding, Bolin email: bolin.ding@alibaba-inc.com organization: Alibaba Group,China – sequence: 8 givenname: Bin surname: Cui fullname: Cui, Bin email: bin.cui@pku.edu.cn organization: School of Computer Science & Key Laboratory of High Confidence Software Technologies (MOE), Peking University |
BookMark | eNotzM9Kw0AQgPFVFGxrn0APeYHE2dmdTeYosdVCQPAPeCubZCIrzUaTKPj2Inr6Lj--pTqJQxSlLjVkWgNf7cqbDZncUoaAmAEA85FaaufIQlEYPlYLNDmlgO7lTK2n6Q1-kdWaYKGwHOI8-mkOX5JU4scY4mvSDWPyKB-fEufgD8mDNEPfS2z9HIZ4rk47f5hk_d-Vet5unsq7tLq_3ZXXVRrQ8ZzWhhpuWxDQFsFi7g3llGPbcW2N087XzIZBC3SapBBsneMatRAVTduYlbr4-wYR2b-Poffj954LQw61-QG880aO |
CODEN | IEEPAD |
ContentType | Conference Proceeding |
DBID | 6IE 6IH CBEJK RIE RIO |
DOI | 10.1109/ICDE53745.2022.00099 |
DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Proceedings Order Plan (POP) 1998-present by volume IEEE Xplore All Conference Proceedings IEEE Electronic Library (IEL) IEEE Proceedings Order Plans (POP) 1998-present |
DatabaseTitleList | |
Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Computer Science |
EISBN | 1665408839 9781665408837 |
EISSN | 2375-026X |
EndPage | 1273 |
ExternalDocumentID | 9835621 |
Genre | orig-research |
GrantInformation_xml | – fundername: National Natural Science Foundation of China grantid: 61832001 funderid: 10.13039/501100001809 |
GroupedDBID | 6IE 6IH 6IL 6IN AAWTH ABLEC ADZIZ ALMA_UNASSIGNED_HOLDINGS BEFXN BFFAM BGNUA BKEBE BPEOZ CBEJK CHZPO IEGSK IJVOP OCL RIE RIL RIO |
ID | FETCH-LOGICAL-i269t-b35c9dd0e01420427a357572df9b43616ab993901e0f15e8e2d669b21e558cdc3 |
IEDL.DBID | RIE |
IngestDate | Wed Aug 27 02:24:33 EDT 2025 |
IsPeerReviewed | false |
IsScholarly | true |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-i269t-b35c9dd0e01420427a357572df9b43616ab993901e0f15e8e2d669b21e558cdc3 |
PageCount | 15 |
ParticipantIDs | ieee_primary_9835621 |
PublicationCentury | 2000 |
PublicationDate | 2022-01-01 |
PublicationDateYYYYMMDD | 2022-01-01 |
PublicationDate_xml | – month: 01 year: 2022 text: 2022-01-01 day: 01 |
PublicationDecade | 2020 |
PublicationTitle | Data engineering |
PublicationTitleAbbrev | ICDE |
PublicationYear | 2022 |
Publisher | IEEE |
Publisher_xml | – name: IEEE |
SSID | ssj0000941150 |
Score | 2.6558657 |
Snippet | Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his... |
SourceID | ieee |
SourceType | Publisher |
StartPage | 1259 |
SubjectTerms | Behavioral sciences Computer vision Conferences Contrastive Learning Data engineering Data mining Data models Deep Learning Multitasking Recom-mender Systems |
Title | Contrastive Learning for Sequential Recommendation |
URI | https://ieeexplore.ieee.org/document/9835621 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8JAEJ4gJ0-oYHxnDx4t0H3RPSMETTQmSsKN7NMYFQ2Wi7_e2W1BYzx4a3rZdh-d75vOfB_AOW6SgBvDZswGm3FniswwLjOtgmFea2RkSe3zVk6m_HomZg242PTCeO9T8Znvxsv0L9-92VVMlfUUwgUZu8a3kLhVvVqbfArSlAhu6u64vK96V8PLkWADLpAF0iTLGQVef3iopBAybsHNevCqcuS5uypN137-0mX879PtQOe7WY_cbcLQLjT8Yg9aa7cGUh_eNtAoRLXUH_H7RmpZ1UeCmJXcp3JqPOovJLLRVxynclrqwHQ8ehhOstoxIXuiUpU4zcIq5_oeiQ-NLhqaIRwbUBeU4UzmUhvEIwgBfD_kwheeOimVobkXorDOsn1oLt4W_gCItk45pGPaFIFLG4wYeMs4s5JRnXN3CO04BfP3ShRjXr_90d-3j2E7LkKVuziBZrlc-VOM5qU5S8v4BTdqn3A |
linkProvider | IEEE |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8JAEJ4QPOgJFYxve_Boge6r3TNCQIGYCAk3sq8ao4LBcvHXO9sWNMaDt6aXbffR-b7pfN8AXOMmSXFjmJCa1ITM6iTUlIlQyVRTpxQystztcyz6U3Y347MK3Gy1MM65vPjMNf1l_i_fLs3ap8paEuGC8KrxHe7FuIVaa5tRQaLi4U2pj4vasjXo3HY5jRlHHkhyY05v8fqji0oeRHo1GG2GL2pHXprrTDfN5y9nxv8-3z40vuV6wcM2EB1AxS0Oobbp1xCUx7cOxFtRrdSH_8IFpbHqU4CoNXjMC6rxsL8Gno--4ThFr6UGTHvdSacflj0TwmciZIYTzY20tu2Q-hDfR0NRBGQxsanUjIpIKI2IBEGAa6cRd4kjVgipSeQ4T4w19Aiqi-XCHUOgjJUWCZnSScqESTWPnaGMGkGJipg9gbqfgvl7YYsxL9_-9O_bV7Dbn4yG8-FgfH8Ge35BikzGOVSz1dpdYGzP9GW-pF-6k6K4 |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=proceeding&rft.title=Data+engineering&rft.atitle=Contrastive+Learning+for+Sequential+Recommendation&rft.au=Xie%2C+Xu&rft.au=Sun%2C+Fei&rft.au=Liu%2C+Zhaoyang&rft.au=Wu%2C+Shiwen&rft.date=2022-01-01&rft.pub=IEEE&rft.eissn=2375-026X&rft.spage=1259&rft.epage=1273&rft_id=info:doi/10.1109%2FICDE53745.2022.00099&rft.externalDocID=9835621 |