Leyang
profile photo

Leyang Cui (崔乐阳)

I am a senior researcher at Tencent AI lab. I obtained my Ph.D. degree at Zhejiang University and Westlake University, advised by Prof. Yue Zhang. My research interests are focused on large language models, specifically on reward models, preference alignment algorithms, and alleviating hallucinations.

Looking for internship or collaboration? drop me an email.

Email: nealcly.nlp AT gmail.com

Google Scholar  /  DBLP

News

  • Aug. 2024: Invited to serve as Session Chair at ACL 2024.

  • Sep. 2023: Invited to serve as Action Editor/Area Chair at EACL, NAACL and ACL 2024.

  • Dec. 2022: Invited to serve as Area Chair (Syntax: Tagging, Chunking and Parsing) at ACL 2023.

  • Jun. 2022: Invited to serve as Area Chair (Dialogue and Interactive Systems) at EMNLP 2022.

  • Experience

  • Jun. 2021 - Dec. 2021, Research Intern, Pattern Recognition Center, Wechat, Tencent. Advised by Fandong Meng
  • Nov. 2020 - May. 2021, Research Intern, NLC Group, MSRA. Advised by Yu Wu and Shujie Liu
  • Jun. 2019 - Sep. 2019, Research Intern, NLC Group, MSRA. Advised by Yu Wu and Shujie Liu
  • Sep. 2017 - Apr. 2018, Research Intern, NLP Department, I2R, ASTAR. Advised by Anh Tuan Luu
  • Publications

    (*: Equal contribution, †: Corresponding author)

    Preprints:

    1. Not All Preference Pairs Are Created Equal: A Recipe for Annotation-Efficient Iterative Preference Learning [PDF]
    2. Sen Yang, Leyang Cui†, Deng Cai, Xinting Huang, Shuming Shi, Wai Lam

    3. Alleviating Hallucinations of Large Language Models through Induced Hallucinations [PDF]
    4. Yue Zhang, Leyang Cui†, Wei Bi, Shuming Shi

    5. Collaborative Evaluation: Exploring the Synergy of Large Language Models and Humans for Open-ended Generation Evaluation [PDF]
    6. Qintong Li, Leyang Cui, Lingpeng Kong, Wei Bi

    7. Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs [PDF]
    8. Sen Yang, Xin Li, Leyang Cui, Lidong Bing, Wai Lam

    9. Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models [PDF]
    10. Yue Zhang, Yafu Li, Leyang Cui†, Deng Cai, Lemao Liu, Tingchen Fu, Xinting Huang, Enbo Zhao, Yu Zhang, Yulong Chen, Longyue Wang, Anh Tuan Luu, Wei Bi, Freda Shi, Shuming Shi

    11. Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: A Preliminary Study on Writing Assistance [PDF]
    12. Yue Zhang, Leyang Cui, Deng Cai, Xinting Huang, Tao Fang, Wei Bi

    13. Towards Robust Online Dialogue Response Generation [PDF]
      Leyang Cui, Fandong Meng, Yijin Liu, Jie Zhou, Yue Zhang

    Conference Papers:

    1. DETect: Deepfake Text Detection in the Wild
    2. Yafu Li, Qintong Li, Leyang Cui†, Wei Bi, Zhilin Wang, Longyue Wang, Linyi Yang, Shuming Shi, Yue Zhang†
      ACL 2024

    3. Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal
    4. Jianheng Huang, Leyang Cui, Ante Wang, Chengyi Yang, Xinting Liao, Linfeng Song, Junfeng Yao, Jinsong Su
      ACL 2024

    5. GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solvers
    6. Qintong Li, Leyang Cui, Xueliang Zhao, Lingpeng Kong, Wei Bi
      ACL 2024

    7. Spotting AI’s Touch: Identifying LLM-Paraphrased Spans in Text
    8. Yafu Li, Zhilin Wang, Leyang Cui†, Wei Bi, Shuming Shi, Yue Zhang†
      Findings of ACL 2024

    9. Benchmarking and Improving Long-Text Translation with Large Language Models
    10. Zefeng Du, Wenxiang Jiao, Longyue Wang, Chenyang Lyu, Jianhui Pang, Leyang Cui, Kaiqiang Song, Derek F. Wong, Shuming Shi, Zhaopeng Tu
      Findings of ACL 2024

    11. Retrieval is Accurate Generation
    12. Bowen Cao, Deng Cai, Leyang Cui, Xuxin Cheng, Wei Bi, Yuexian Zou, Shuming Shi
      ICLR 2024

    13. NaRuto: Automatically Acquiring Planning Models from Narrative Texts
    14. Ruiqi Li, Leyang Cui, Songtuan Lin, Patrik Haslum
      AAAI 2024

    15. EDeR: Towards Understanding Dependency Relations Between Events
    16. Ruiqi Li, Patrik Haslum, Leyang Cui
      EMNLP 2023

    17. RobustGEC: Robust Grammatical Error Correction Against Subtle Context Perturbation
      Yue Zhang, Leyang Cui†, Enbo Zhao, Wei Bi, Shuming Shi
      EMNLP 2023

    18. Non-autoregressive Text Editing with Copy-aware Latent Alignments
      Yu Zhang*, Yue Zhang*, Leyang Cui, Guohong Fu
      EMNLP 2023

    19. LogiCoT: Logical Chain-of-Thought Instruction Tuning
      Hanmeng Liu, Zhiyang Teng, Leyang Cui, Chaoli Zhang, Qiji Zhou, Yue Zhang
      Findings of EMNLP 2023

    20. Explicit Syntactic Guidance for Neural Text Generation
      Yafu Li, Leyang Cui†, Jianhao Yan, Yongjing Yin, Wei Bi, Shuming Shi, Yue Zhang†
      ACL 2023, Best Paper Nomination (1.6%)

    21. Enhancing Grammatical Error Correction Systems with Explanations
      Yuejiao Fei, Leyang Cui†, Sen Yang, Wai Lam, Zhenzhong Lan, Shuming Shi
      ACL 2023

    22. Uni-Encoder: A Fast and Accurate Response Selection Paradigm for Generation-Based Dialogue Systems
      Chiyu Song, Hongliang He, Haofei Yu, Pengfei Fang, Leyang Cui, Zhenzhong Lan
      Findings of ACL 2023

    23. Cross-domain Generalization for AMR Parsing
      Xuefeng Bai, Sen Yang, Leyang Cui, Linfeng Song, Yue Zhang
      EMNLP 2022

    24. Multi-Granularity Optimization for Non-Autoregressive Translation
      Yafu Li, Leyang Cui†, Yongjing Yin, Yue Zhang†
      EMNLP 2022

    25. FactMix: Using a Few Labeled In-domain Examples to Generalize to Cross-domain Named Entity Recognition
      Linyi Yang, Lifan Yuan, Leyang Cui, Wenyang Gao, Yue Zhang
      COLING 2022

    26. Investigating Non-local Features for Neural Constituency Parsing
      Leyang Cui*, Sen Yang*, Yue Zhang
      ACL 2022

    27. Challenges to Open-Domain Constituency Parsing
      Sen Yang, Leyang Cui, Ruoxi Ning, Di Wu, Yue Zhang
      Findings of ACL 2022

    28. Knowledge Enhanced Fine-tuning for Better Handling Unseen Entities in Dialogue Generation
      Leyang Cui, Yu Wu, Shujie Liu, Yue Zhang
      EMNLP 2021

    29. Solving Aspect Category Sentiment Analysis as a Text Generation Task
      Jian Liu, Zhiyang Teng, Leyang Cui, Hanmeng Liu, Yue Zhang
      EMNLP 2021

    30. Template-based Named Entity Recognition Using BART
      Leyang Cui, Yu Wu, Jian Liu, Sen Yang, Yue Zhang
      Findings of ACL 2021

    31. On Commonsense Cues in BERT for Solving Commonsense Tasks
      Leyang Cui, Sijie Cheng, Yu Wu, Yue Zhang
      Findings of ACL 2021

    32. Natural Language Inference in Context Investigating Contextual Reasoning over Long Texts
      Hangmeng Liu, Leyang Cui, Jian Liu, Yue Zhang
      AAAI 2021

    33. MuTual: A Dataset for Multi-Turn Dialogue Reasoning
      Leyang Cui, Yu Wu, Shujie Liu, Yue Zhang, Ming Zhou
      ACL 2020

    34. What Have We Achieved on Text Summarization?
      Dandan Huang*, Leyang Cui*, Sen Yang*, Guangsheng Bao, Kun Wang, Jun Xie, Yue Zhang
      EMNLP 2020

    35. Making the Best Use of Review Summary for Sentiment Analysis
      Sen Yang*, Leyang Cui*, Jun Xie, Yue Zhang
      COLING 2020

    36. Does Chinese BERT Encode Word Structure?
      Yile Wang, Leyang Cui, Yue Zhang
      COLING 2020

    37. LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical Reasoning
      Jian Liu, Leyang Cui, Hanmeng Liu, Dandan Huang, Yile Wang, Yue Zhang
      IJCAI 2020

    38. Evaluating Commonsense in Pre-trained Language Models
      Xuhui Zhou, Yue Zhang, Leyang Cui, Dandan Huang
      AAAI 2020

    39. Hierarchically-Refined Label Attention Network for Sequence Labeling
      Leyang Cui, Yue Zhang
      EMNLP 2019

    Journal Papers:

    1. LogiQA 2.0—An Improved Dataset for Logical Reasoning in Natural Language Understanding
      Hanmeng Liu, Jian Liu, Leyang Cui, Zhiyang Teng, Nan Duan, Ming Zhou, Yue Zhang
      IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2023

    2. Label Attention Network for Structured Prediction
      Leyang Cui*, Yafu Li*, Yue Zhang
      IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2022

    3. Improving Skip-gram Embeddings Using BERT
      Yile Wang, Leyang Cui, Yue Zhang
      IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2021

    Services

  • Senior Program Committee Members: IJCAI 2021
  • Area Chair: EMNLP 2022, ACL 2023, EACL 2024, NAACL 2024, ACL 2024
  • Reviewer: TASLP, TACL
  • Program Committee Members: NAACL 2022, ACL 2022, AAAI 2021, ACL 2021, EMNLP 2021, AAAI 2020, EMNLP 2020, COLING 2020, IJCAI 2020.
  • Awards

  • Westlake Presidential Award, 2022

  • Stars of Tomorrow, MSRA, 2021

  • Outstanding Students, Zhejiang University, 2019, 2020 and 2021

  • National Scholarship, 2019