Data-Free Distillation of Language Model by Text-to-Text Transfer
Bai, Zheyuan, Liu, Xinduo, Hu, Hailin, Guo, Tianyu, Zhang, Qinghua, Wang, Yunhe
Year of Publication 02.11.2023
Year of Publication 02.11.2023
Get full text
Journal Article
Multiscale Positive-Unlabeled Detection of AI-Generated Texts
Tian, Yuchuan, Chen, Hanting, Wang, Xutao, Bai, Zheyuan, Zhang, Qinghua, Li, Ruifeng, Xu, Chao, Wang, Yunhe
Year of Publication 29.05.2023
Year of Publication 29.05.2023
Get full text
Journal Article
Rethinking Optimization and Architecture for Tiny Language Models
Tang, Yehui, Liu, Fangcheng, Ni, Yunsheng, Tian, Yuchuan, Bai, Zheyuan, Hu, Yi-Qi, Liu, Sichao, Jui, Shangling, Han, Kai, Wang, Yunhe
Year of Publication 05.02.2024
Year of Publication 05.02.2024
Get full text
Journal Article
PanGu-$\pi$: Enhancing Language Model Architectures via Nonlinearity Compensation
Wang, Yunhe, Chen, Hanting, Tang, Yehui, Guo, Tianyu, Han, Kai, Nie, Ying, Wang, Xutao, Hu, Hailin, Bai, Zheyuan, Wang, Yun, Liu, Fangcheng, Liu, Zhicheng, Guo, Jianyuan, Zeng, Sinan, Zhang, Yinchen, Xu, Qinghua, Liu, Qun, Yao, Jun, Xu, Chao, Tao, Dacheng
Year of Publication 27.12.2023
Year of Publication 27.12.2023
Get full text
Journal Article