Yimeng Zeng

PhD Student

Computer Science
University of Pennsylvania

Email: [email protected]

Curriculum Vitae  /  GitHub  /  Google Scholar  /  X  /  LinkedIn

Yimeng Zeng

About Me

I am a fourth-year PhD student in the Department of Computer and Information Science at the University of Pennsylvania, advised by Jacob Gardner and Osbert Bastani. Previously, I completed my undergraduate degrees in Computer Science and Mathematics at Cornell University.

My research develops LLM-centric generative optimization methods, combining generative models (e.g., VAEs/LLMs) with Bayesian optimization (BO) to solve open-ended design problems efficiently. I focus on end-to-end, closed-loop systems that propose candidates, evaluate them, and learn from feedback. Applications include biomedical discovery (antibody/peptide design) and systems performance optimization (query planning and code optimization).

Research

* indicates equal contribution. See Google Scholar for a complete list of publications.

Topics: LLM · Optimization · Systems · Biology

LLMs & Learning-Based Optimization

  • Scaling Multi-Task Bayesian Optimization with Large Language Models
    Yimeng Zeng, Natalie Maus, Haydn Thomas Jones, Jeffrey Tao, Fangping Wan, Marcelo Der Torossian Torres, Cesar de la Fuente-Nunez, Ryan Marcus, Osbert Bastani, Jacob R Gardner
    International Conference on Learning Representations (ICLR 2026)
    LLM · Optimization
  • Purely Agentic Black-Box Optimization for Biological Design
    Natalie Maus, Yimeng Zeng, Haydn Thomas Jones, Yining Huang, Gaurav Ng Goel, Alden Rose, Kyurae Kim, Hyun-Su Lee, Marcelo Der Torossian Torres, Fangping Wan, Cesar de la Fuente-Nunez, Mark Yatskar, Osbert Bastani, Jacob R. Gardner
    arXiv preprint, 2026
    LLM · Optimization · Biology
  • Zeroth-Order Fine-Tuning of LLMs with Transferable Static Sparsity
    Wentao Guo, Jikai Long, Yimeng Zeng, Zirui Liu, Xinyu Yang, Yide Ran, Jacob R. Gardner, Osbert Bastani, Christopher De Sa, Xiaodong Yu, Beidi Chen, Zhaozhuo Xu
    International Conference on Learning Representations (ICLR 2025)
    LLM · Optimization
  • Learned Offline Query Planning via Bayesian Optimization
    Jeffrey Tao, Natalie Maus, Haydn Jones, Yimeng Zeng, Jacob R. Gardner, Ryan Marcus
    ACM SIGMOD International Conference on Management of Data (SIGMOD 2025) [code]
    LLM · Optimization · Systems
  • Automated High-Level Code Optimization for Warehouse Performance
    Alexander Shypula, Aman Madaan, Yimeng Zeng, Uri Alon, Jacob Gardner, Milad Hashemi, Graham Neubig, Parthasarathy Ranganathan, Osbert Bastani, Amir Yazdanbakhsh
    IEEE Micro, "Top Picks" issue, 2025
    LLM · Systems
  • Learning Performance-Improving Code Edits
    Alexander Shypula, Aman Madaan, Yimeng Zeng, Uri Alon, Jacob Gardner, Milad Hashemi, Graham Neubig, Parthasarathy Ranganathan, Osbert Bastani, Amir Yazdanbakhsh
    International Conference on Learning Representations (ICLR 2024) Spotlight [code]
    LLM · Systems

Bayesian Optimization & Scientific Design

Teaching

  • Graduate Teaching Assistant, CIS 5200 Introduction to Machine Learning (Fall 2023)
  • Graduate Teaching Assistant, CIS 6200 Advanced Topics in Machine Learning (Spring 2026)
  • Undergraduate Teaching Assistant, CS 4780 Introduction to Machine Learning, Cornell University (2021-2022)

Service

Reviewer: NeurIPS 2024, ACL ARR (June 2024), NeurIPS 2025, ICLR 2026

Honors & Awards

  • University of Pennsylvania Graduate Fellowship
  • Cornell University Dean's List, College of Arts and Sciences (Fall 2019, Fall 2020)

Modified from Jon Barron.