About
I am a CS Ph.D. student at the University of Illinois Urbana-Champaign in the PL/FM/SE group, advised by Prof. Lingming Zhang. You can find my CV here.
My research fields are Software Engineering and Machine Learning. Specifically, I focus on building large language models to solve software engineering tasks, with a specific interest in improving LLM’s reasoning and planning capabilities for code generation and repair through pre-training and post-training.
I obtained my bachelor’s degrees at Tsinghua University, including one in Software Engineering from the School of Software and one in Business Administration from the School of Economics and Management. I was a research assistant at Software System Security Assurance Group during my undergraduate years, advised by Prof. Yu Jiang.
Selected Publications (See full list on Google Scholar)
- Horizon-Length Prediction: Advancing Fill-in-the-Middle Capabilities for Code Generation with Lookahead Planning
Yifeng Ding, Hantian Ding, Shiqi Wang, Qing Sun, Varun Kumar, and Zijian Wang
arXiv; NeurIPS 2024 System 2 Reasoning Workshop. [preprint] [summary] - XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts
Yifeng Ding, Jiawei Liu, Yuxiang Wei, and Lingming Zhang
62nd Annual Meeting of the Association for Computational Linguistics
(ACL 2024), Pages 12941–-12955, August 2024. [paper] [summary] [code] - SelfCodeAlign: Self-Alignment for Code Generation
Yuxiang Wei, Federico Cassano, Jiawei Liu, Yifeng Ding, Naman Jain, Zachary Mueller, Harm de Vries, Leandro Von Werra, Arjun Guha, and Lingming Zhang
Thirty-eighth Conference on Neural Information Processing Systems
(NeurIPS 2024), To appear, December 2024. [preprint] [code] [model] [dataset] - Magicoder: Empowering Code Generation with OSS-Instruct
Yuxiang Wei, Zhe Wang, Jiawei Liu, Yifeng Ding, and Lingming Zhang
Forty-first International Conference on Machine Learning
(ICML 2024), Pages 52632–52657, July 2024. [paper] [code] [model] [dataset] - Evaluating Language Models for Efficient Code Generation
Jiawei Liu, Songrun Xie, Junhao Wang, Yuxiang Wei, Yifeng Ding, and Lingming Zhang
First Conference on Language Modeling
(COLM 2024), October 2024. [paper] [code] - RepoQA: Evaluating Long Context Code Understanding
Jiawei Liu, Jia Le Tian, Vijay Daita, Yuxiang Wei, Yifeng Ding, Yuhan Katherine Wang, Jun Yang, Lingming Zhang
First Workshop on Long-Context Foundation Models @ ICML 2024
(LCFM @ ICML 2024), July 2024. [paper] [code] - The Plastic Surgery Hypothesis in the Era of Large Language Models
Chunqiu Steven Xia, Yifeng Ding, and Lingming Zhang
38th IEEE/ACM International Conference on Automated Software Engineering
(ASE 2023), Pages 522–534, September 2023. [paper]
Academic Services
- Reviewer: AISTATS’25, ICLR’25, NeurIPS’24, ACL’24, EMNLP’24, NAACL’25
- Organizing Committee: LLM4Code@ICSE’25 (International Workshop on Large Language Models for Code, co-organized with ICSE’25), LLM4Code@ICSE’24
Invited Talks
- UCLA Artificial General Intelligence Lab (11/2024): “Improving Code Language Modeling via Horizon-Length Prediction”
- UIUC FM/SE Seminar (10/2024): “Horizon-Length Prediction: Advancing Fill-in-the-Middle Capabilities for Code Generation with Lookahead Planning”
- Amazon Comprehend Team (07/2024): “XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts”
- Uber Programming Systems Team (04/2023): “Equipping Large Language Models with Domain-Specific Knowledge for Automated Program Repair”
Contacts
- Email: yifeng6@illinois.edu
- Address: 2107 Thomas M. Siebel Center for Computer Science