Leyang Cui (崔乐阳)
I am a senior researcher at Tencent AI lab.
I obtained my Ph.D. degree at Zhejiang University and Westlake University, advised by Prof. Yue Zhang. My research interests are focused on large language models, specifically on reward models, preference alignment algorithms, and methods for alleviating hallucinations.
Looking for internship or collaboration? drop me an email.
Email: nealcly.nlp AT gmail.com
Google Scholar  / 
DBLP
News
Aug. 2024: Invited to serve as Session Chair at ACL 2024.
Sep. 2023: Invited to serve as Action Editor/Area Chair at EACL, NAACL and ACL 2024.
Dec. 2022: Invited to serve as Area Chair (Syntax: Tagging, Chunking and Parsing) at ACL 2023.
Jun. 2022: Invited to serve as Area Chair (Dialogue and Interactive Systems) at EMNLP 2022.
Experience
Jun. 2021 - Dec. 2021, Research Intern, Pattern Recognition Center, Wechat, Tencent. Advised by Fandong Meng
Nov. 2020 - May. 2021, Research Intern, NLC Group, MSRA. Advised by Yu Wu and Shujie Liu
Jun. 2019 - Sep. 2019, Research Intern, NLC Group, MSRA. Advised by Yu Wu and Shujie Liu
Sep. 2017 - Apr. 2018, Research Intern, NLP Department, I2R, ASTAR. Advised by Anh Tuan Luu
Publications
(*: Equal contribution, †: Corresponding author)
Preprints:
-
Alleviating Hallucinations of Large Language Models through Induced Hallucinations [PDF]
Yue Zhang, Leyang Cui†, Wei Bi, Shuming Shi
-
Collaborative Evaluation: Exploring the Synergy of Large Language Models and Humans for Open-ended Generation Evaluation [PDF]
Qintong Li, Leyang Cui, Lingpeng Kong, Wei Bi
- Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs [PDF]
Sen Yang, Xin Li, Leyang Cui, Lidong Bing, Wai Lam
-
Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models [PDF]
Yue Zhang, Yafu Li, Leyang Cui†, Deng Cai, Lemao Liu, Tingchen Fu, Xinting Huang, Enbo Zhao, Yu Zhang, Yulong Chen, Longyue Wang, Anh Tuan Luu, Wei Bi, Freda Shi, Shuming Shi
-
Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: A Preliminary Study on Writing Assistance
[PDF]
Yue Zhang, Leyang Cui, Deng Cai, Xinting Huang, Tao Fang, Wei Bi
- Towards Robust Online Dialogue Response Generation [PDF]
Leyang Cui, Fandong Meng, Yijin Liu, Jie Zhou, Yue Zhang
Conference Papers:
- Gated Slot Attention for Efficient Linear-Time Sequence Modeling
Yu Zhang, Songlin Yang, Rui-Jie Zhu, Yue Zhang, Leyang Cui, Yiqiao Wang, Bolun Wang, Freda Shi, Bailin Wang, Wei Bi, Peng Zhou, Guohong Fu
NeurIPS 2024
- Knowledge Verification to Nip Hallucination in the Bud
Fanqi Wan, Xinting Huang, Leyang Cui, Xiaojun Quan, Wei Bi, Shuming Shi
EMNLP 2024
- Not All Preference Pairs Are Created Equal: A Recipe for Annotation-Efficient Iterative Preference Learning
Sen Yang, Leyang Cui†, Deng Cai, Xinting Huang, Shuming Shi, Wai Lam
Findings of EMNLP 2024
- Selection-p: Self-Supervised Task-Agnostic Prompt Compression for Faithfulness and Transferability
Tsz Ting Chung, Leyang Cui, Lemao Liu, Xinting Huang, Shuming Shi, Dit-Yan Yeung
Findings of EMNLP 2024
-
DETect: Deepfake Text Detection in the Wild
Yafu Li, Qintong Li, Leyang Cui†, Wei Bi, Zhilin Wang, Longyue Wang, Linyi Yang, Shuming Shi, Yue Zhang†
ACL 2024
-
Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal
Jianheng Huang, Leyang Cui, Ante Wang, Chengyi Yang, Xinting Liao, Linfeng Song, Junfeng Yao, Jinsong Su
ACL 2024
-
GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solvers
Qintong Li, Leyang Cui, Xueliang Zhao, Lingpeng Kong, Wei Bi
ACL 2024
-
Spotting AI’s Touch: Identifying LLM-Paraphrased Spans in Text
Yafu Li, Zhilin Wang, Leyang Cui†, Wei Bi, Shuming Shi, Yue Zhang†
Findings of ACL 2024
-
Benchmarking and Improving Long-Text Translation with Large Language Models
Zefeng Du, Wenxiang Jiao, Longyue Wang, Chenyang Lyu, Jianhui Pang, Leyang Cui, Kaiqiang Song, Derek F. Wong, Shuming Shi, Zhaopeng Tu
Findings of ACL 2024
-
Retrieval is Accurate Generation
Bowen Cao, Deng Cai, Leyang Cui, Xuxin Cheng, Wei Bi, Yuexian Zou, Shuming Shi
ICLR 2024
-
NaRuto: Automatically Acquiring Planning Models from Narrative Texts
Ruiqi Li, Leyang Cui, Songtuan Lin, Patrik Haslum
AAAI 2024
-
EDeR: Towards Understanding Dependency Relations Between Events
Ruiqi Li, Patrik Haslum, Leyang Cui†
EMNLP 2023
-
RobustGEC: Robust Grammatical Error Correction Against Subtle Context Perturbation
Yue Zhang, Leyang Cui†, Enbo Zhao, Wei Bi, Shuming Shi
EMNLP 2023
-
Non-autoregressive Text Editing with Copy-aware Latent Alignments
Yu Zhang*, Yue Zhang*, Leyang Cui, Guohong Fu
EMNLP 2023
-
LogiCoT: Logical Chain-of-Thought Instruction Tuning
Hanmeng Liu, Zhiyang Teng, Leyang Cui, Chaoli Zhang, Qiji Zhou, Yue Zhang
Findings of EMNLP 2023
- Explicit Syntactic Guidance for Neural Text Generation
Yafu Li, Leyang Cui†, Jianhao Yan, Yongjing Yin, Wei Bi, Shuming Shi, Yue Zhang†
ACL 2023, Best Paper Nomination (1.6%)
- Enhancing Grammatical Error Correction Systems with Explanations
Yuejiao Fei, Leyang Cui†, Sen Yang, Wai Lam, Zhenzhong Lan, Shuming Shi
ACL 2023
- Uni-Encoder: A Fast and Accurate Response Selection Paradigm for Generation-Based Dialogue Systems
Chiyu Song, Hongliang He, Haofei Yu, Pengfei Fang, Leyang Cui, Zhenzhong Lan
Findings of ACL 2023
- Cross-domain Generalization for AMR Parsing
Xuefeng Bai, Sen Yang, Leyang Cui, Linfeng Song, Yue Zhang
EMNLP 2022
- Multi-Granularity Optimization for Non-Autoregressive Translation
Yafu Li, Leyang Cui†, Yongjing Yin, Yue Zhang†
EMNLP 2022
- FactMix: Using a Few Labeled In-domain Examples to Generalize to Cross-domain Named Entity Recognition
Linyi Yang, Lifan Yuan, Leyang Cui, Wenyang Gao, Yue Zhang
COLING 2022
- Investigating Non-local Features for Neural Constituency Parsing
Leyang Cui*, Sen Yang*, Yue Zhang
ACL 2022
- Challenges to Open-Domain Constituency Parsing
Sen Yang, Leyang Cui, Ruoxi Ning, Di Wu, Yue Zhang
Findings of ACL 2022
- Knowledge Enhanced Fine-tuning for Better Handling Unseen Entities in Dialogue Generation
Leyang Cui, Yu Wu, Shujie Liu, Yue Zhang
EMNLP 2021
- Solving Aspect Category Sentiment Analysis as a Text Generation Task
Jian Liu, Zhiyang Teng, Leyang Cui, Hanmeng Liu, Yue Zhang
EMNLP 2021
- Template-based Named Entity Recognition Using BART
Leyang Cui, Yu Wu, Jian Liu, Sen Yang, Yue Zhang
Findings of ACL 2021
- On Commonsense Cues in BERT for Solving Commonsense Tasks
Leyang Cui, Sijie Cheng, Yu Wu, Yue Zhang
Findings of ACL 2021
- Natural Language Inference in Context Investigating Contextual Reasoning over Long Texts
Hangmeng Liu, Leyang Cui, Jian Liu, Yue Zhang
AAAI 2021
- MuTual: A Dataset for Multi-Turn Dialogue Reasoning
Leyang Cui, Yu Wu, Shujie Liu, Yue Zhang, Ming Zhou
ACL 2020
- What Have We Achieved on Text Summarization?
Dandan Huang*, Leyang Cui*, Sen Yang*, Guangsheng Bao, Kun Wang, Jun Xie, Yue Zhang
EMNLP 2020
- Making the Best Use of Review Summary for Sentiment Analysis
Sen Yang*, Leyang Cui*, Jun Xie, Yue Zhang
COLING 2020
- Does Chinese BERT Encode Word Structure?
Yile Wang, Leyang Cui, Yue Zhang
COLING 2020
- LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical Reasoning
Jian Liu, Leyang Cui, Hanmeng Liu, Dandan Huang, Yile Wang, Yue Zhang
IJCAI 2020
- Evaluating Commonsense in Pre-trained Language Models
Xuhui Zhou, Yue Zhang, Leyang Cui, Dandan Huang
AAAI 2020
- Hierarchically-Refined Label Attention Network for Sequence Labeling
Leyang Cui, Yue Zhang
EMNLP 2019
Journal Papers:
- LogiQA 2.0—An Improved Dataset for Logical Reasoning in Natural Language Understanding
Hanmeng Liu, Jian Liu, Leyang Cui, Zhiyang Teng, Nan Duan, Ming Zhou, Yue Zhang
IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2023
- Label Attention Network for Structured Prediction
Leyang Cui*, Yafu Li*, Yue Zhang
IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2022
- Improving Skip-gram Embeddings Using BERT
Yile Wang, Leyang Cui, Yue Zhang
IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2021
Services
Senior Program Committee Members: IJCAI 2021
Area Chair: EMNLP 2022, ACL 2023, EACL 2024, NAACL 2024, ACL 2024
Reviewer: TASLP, TACL
Program Committee Members: NAACL 2022, ACL 2022, AAAI 2021, ACL 2021, EMNLP 2021, AAAI 2020, EMNLP 2020, COLING 2020, IJCAI 2020.
Awards
Westlake Presidential Award, 2022
Stars of Tomorrow, MSRA, 2021
Outstanding Students, Zhejiang University, 2019, 2020 and 2021
National Scholarship, 2019