About me

I am a second-year PhD student at Peking University advised by incredible Prof.Di He. I’m interested in deep learning and its application to NLP and AI4science. Currently, I’m a research intern at ByteDance Doubao (Seed) with Jingjing Xu. I’ve also interned at MSRA with Lijun Wu and DP Technology with Guolin Ke.

Publication

Let the Code LLM Edit Itself When You Edit the Code, ICLR 2025 [paper] [code will release soon]
Zhenyu He, Jun Zhang, Shengjie Luo, Jingjing Xu, Zhi Zhang, Di He

Exploiting Pre-trained Models for Drug Target Affinity Prediction with Nearest Neighbors, CIKM 2024 [paper]
Qizhi Pei, Lijun Wu, Zhenyu He, Jinhua Zhu, Yingce Xia, Shufang Xie, Rui Yan

Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation, ICML 2024 [paper] [code] [paperweekly]
Zhenyu He*, Guhao Feng*, Shengjie Luo*, Kai Yang, Liwei Wang, Jingjing Xu, Zhi Zhang, Hongxia Yang, Di He

Do Efficient Transformers Really Save Computation?, ICML 2024 [paper]
Kai Yang, Jan Ackermann, Zhenyu He, Guhao Feng, Bohang Zhang, Yunzhen Feng, Qiwei Ye, Di He, Liwei Wang

REST: Retrieval-Based Speculative Decoding, NAACL 2024 [paper] [code] [blog] [paperweekly]
Zhenyu He*, Zexuan Zhong*, Tianle Cai*, Jason D. Lee, Di He

Uni-Fold MuSSe: De Novo Protein Complex Prediction with Protein Language Models, ICLR 2023 MLDD workshop, [paper] [code]
Jinhua Zhu*, Zhenyu He*, Ziyao Li, Guolin Ke, Linfeng Zhang

Rumor Detection on Social Media with Event Augmentations, SIGIR 2021(short) [paper] [code]
Zhenyu He*, Ce Li*, Fan Zhou, Yi Yang

Preprint

Examining User-Friendly and Open-Sourced Large GPT Models: A Survey on Language, Multimodal, and Scientific GPT Models, arXiv 2023 [paper]
Kaiyuan Gao*, Sunan He*, Zhenyu He*, Jiacheng Lin*, Qizhi Pei*, Jie Shao*, Wei Zhang*

Two-Stage Neural Contextual Bandits for Personalised News Recommendation, arXiv 2022 [paper]
Mengyan Zhang, Thanh Nguyen-Tang, Fangzhao Wu, Zhenyu He, Xing Xie, Cheng Soon Ong

Education Experience

Peking University

Sep. 2023 - Now

PhD student, School of Artificial Intelligence

University of Electronic Science and Technology of China

Sep. 2019 - Jun. 2023

B.E. in Software Engineering

GPA: 91+/100

Awards

Peking University Presidential Scholarship (the highest doctoral research honor at Peking University)

Professional Services

Reviewer for ICML 2024, COLM 2024, NeurIPS 2024, ICLR 2025.