About me

I am a second-year PhD student at Peking University advised by incredible Prof.Di He. I’m interested in deep learning and its application to NLP and AI4science. Currently, I’m a research intern at ByteDance Doubao (Seed) with Jingjing Xu. I’ve also interned at MSRA with Lijun Wu and DP Technology with Guolin Ke.

Publication

Exploiting Pre-trained Models for Drug Target Affinity Prediction with Nearest Neighbors, CIKM 2024 [paper]
Qizhi Pei, Lijun Wu, Zhenyu He, Jinhua Zhu, Yingce Xia, Shufang Xie, Rui Yan

Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation, ICML 2024 [paper] [code] [paperweekly]
Zhenyu He*, Guhao Feng*, Shengjie Luo*, Kai Yang, Liwei Wang, Jingjing Xu, Zhi Zhang, Hongxia Yang, Di He

Do Efficient Transformers Really Save Computation?, ICML 2024 [paper]
Kai Yang, Jan Ackermann, Zhenyu He, Guhao Feng, Bohang Zhang, Yunzhen Feng, Qiwei Ye, Di He, Liwei Wang

REST: Retrieval-Based Speculative Decoding, NAACL 2024 [paper] [code] [blog] [paperweekly]
Zhenyu He*, Zexuan Zhong*, Tianle Cai*, Jason D. Lee, Di He

Uni-Fold MuSSe: De Novo Protein Complex Prediction with Protein Language Models, ICLR 2023 MLDD workshop, [paper] [code]
Jinhua Zhu*, Zhenyu He*, Ziyao Li, Guolin Ke, Linfeng Zhang

Rumor Detection on Social Media with Event Augmentations, SIGIR 2021(short) [paper] [code]
Zhenyu He*, Ce Li*, Fan Zhou, Yi Yang

Preprint

Let the Code LLM Edit Itself When You Edit the Code, arXiv 2024 [paper]
Zhenyu He, Jun Zhang, Shengjie Luo, Jingjing Xu, Zhi Zhang, Di He

Examining User-Friendly and Open-Sourced Large GPT Models: A Survey on Language, Multimodal, and Scientific GPT Models, arXiv 2023 [paper]
Kaiyuan Gao*, Sunan He*, Zhenyu He*, Jiacheng Lin*, Qizhi Pei*, Jie Shao*, Wei Zhang*

Two-Stage Neural Contextual Bandits for Personalised News Recommendation, arXiv 2022 [paper]
Mengyan Zhang, Thanh Nguyen-Tang, Fangzhao Wu, Zhenyu He, Xing Xie, Cheng Soon Ong

Education Experience

Peking University

Sep. 2023 - Now

PhD student, School of Artificial Intelligence

University of Electronic Science and Technology of China

Sep. 2019 - Jun. 2023

B.E. in Software Engineering

GPA: 91+/100

Awards

Peking University Presidential Scholarship (the highest doctoral research honor at Peking University)

Professional Services

Reviewer for ICML 2024, COLM 2024, NeurIPS 2024.