DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
DeepSeek-AI, Liu, Aixin, Feng, Bei, Wang, Bin, Wang, Bingxuan, Liu, Bo, Zhao, Chenggang, Dengr, Chengqi, Dai, Damai, Guo, Daya, Ji, Dongjie, Li, Erhang, Lin, Fangyun, Luo, Fuli, Hao, Guangbo, Chen, Guanting, Xu, Hanwei, Gao, Huazuo, Qu, Hui, Cai, J. L, Liang, Jian, Ni, Jiaqi, Li, Jiashi, Qiu, Junjie, Dong, Kai, Gao, Kaige, Zhang, Lecong, Xu, Lei, Xia, Leyi, Zhang, Liyue, Li, Meng, Wang, Miaojun, Zhang, Mingchuan, Li, Mingming, Tian, Ning, Wang, Peiyi, Zhu, Qihao, Du, Qiushi, Jin, R. L, Ge, Ruiqi, Pan, Ruizhe, Xu, Runxin, Li, S. S, Lu, Shanghao, Chen, Shanhuang, Wu, Shaoqing, Ye, Shengfeng, Ma, Shirong, Wang, Shiyu, Zhou, Shuang, Zhou, Shunfeng, Zheng, Size, Wang, T, Yuan, Tian, Zeng, Wangding, An, Wei, Liu, Wen, Liang, Wenfeng, Gao, Wenjun, Zhang, Wentao, Jin, Xiangyue, Wang, Xianzu, Liu, Xiaodong, Wang, Xiaohan, Chen, Xiaokang, Chen, Xiaosha, Nie, Xiaotao, Sun, Xiaowen, Wang, Xiaoxiang, Liu, Xin, Lu, Xuan, Su, Xuecheng, Wu, Y, Li, Y. K, Wei, Y. X, Zhu, Y. X, Xu, Yanhong, Huang, Yanping, Sun, Yaofeng, Wang, Yaohui, Zheng, Yi, Tang, Ying, Piao, Yishi, Dong, Yixin, Liu, Yiyuan, Wang, Yongji, Guo, Yongqiang, Zhu, Yuchen, Wang, Yuduan, Zou, Yuheng, Zha, Yukun, Yan, Yuting, You, Yuxiang, Liu, Yuxuan, Ren, Zehui, Sha, Zhangli, Huang, Zhen, Shao, Zhihong, Wen, Zhiniu, Li, Zhuoshu
Year of Publication 07.05.2024
Year of Publication 07.05.2024
Get full text
Journal Article
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
Liu, Aixin, Feng, Bei, Wang, Bin, Wang, Bingxuan, Liu, Bo, Zhao, Chenggang, Dengr, Chengqi, Dai, Damai, Guo, Daya, Ji, Dongjie, Li, Erhang, Lin, Fangyun, Luo, Fuli, Guangbo Hao, Chen, Guanting, Xu, Hanwei, Huajian Xin, Gao, Huazuo, Qu, Hui, Liang, Jian, Ni, Jiaqi, Li, Jiashi, Jingyang Yuan, Qiu, Junjie, Dong, Kai, Gao, Kaige, Zhang, Lecong, Xu, Lei, Xia, Leyi, Zhang, Liyue, Li, Meng, Wang, Miaojun, Zhang, Mingchuan, Li, Mingming, Tian, Ning, Wang, Peiyi, Zhu, Qihao, Du, Qiushi, Chen, R J, Ge, Ruiqi, Xu, Runxin, Li, S S, Lu, Shanghao, Chen, Shanhuang, Wu, Shaoqing, Ye, Shengfeng, Ma, Shirong, Wang, Shiyu, Zhou, Shuang, Zhou, Shunfeng, Wang, T, Tian Pei, Tian Yuan, Xiao, W L, Zeng, Wangding, An, Wei, Liu, Wen, Liang, Wenfeng, Gao, Wenjun, Zhang, Wentao, Li, X Q, Jin, Xiangyue, Wang, Xianzu, Liu, Xiaodong, Wang, Xiaohan, Chen, Xiaokang, Nie, Xiaotao, Sun, Xiaowen, Wang, Xiaoxiang, Liu, Xin, Lu, Xuan, Su, Xuecheng, Y Wu, Li, Y K, Wei, Y X, Zhu, Y X, Xu, Yanhong, Sun, Yaofeng, Wang, Yaohui, Zheng, Yi, Tang, Ying, Piao, Yishi, Dong, Yixin, Liu, Yiyuan, Wang, Yongji, Guo, Yongqiang, Zhu, Yuchen, Wang, Yuduan, Zou, Yuheng, Zha, Yukun, Yan, Yuting, You, Yuxiang, Liu, Yuxuan, Ren, Zehui, Sha, Zhangli, Huang, Zhen, Zhewen Hao, Shao, Zhihong, Wen, Zhiniu, Li, Zhuoshu
Published in arXiv.org (19.06.2024)
Get full text
Published in arXiv.org (19.06.2024)
Paper