profile photo

Yushi Bai 白雨石

I am a second-year Ph.D. student at Tsinghua University, advised by Prof. Juanzi Li. I reveived my B.E. in Yao class from Tsinghua University in 2022. I have been very fortunate to work with Prof. Zhiyuan Liu, Prof. Jure Leskovec, and Prof. Ariel Procaccia.

Email  /  Google Scholar  /  Github /  Selected Publications /  Experience /  Honors & Awards

Selected Publications

My research interest lies in large language model, graphs, and game theory. I am currently working on long context language models. Here are some of my lead works:

LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
Yushi Bai, Jiajie Zhang, Xin Lv, Linzhi Zheng, Siqi Zhu, Lei Hou, Yuxiao Dong, Jie Tang, Juanzi Li
arXiv
[paper] [code]

LongAlign: A Recipe for Long Context Alignment of Large Language Models
Yushi Bai, Xin Lv, Jiajie Zhang, Yuze He, Ji Qi, Lei Hou, Jie Tang, Yuxiao Dong, Juanzi Li
EMNLP 2024
[paper] [code]

LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding
Yushi Bai, Xin Lv, Jiajie Zhang, Hongchang Lyu, Jiankai Tang, Zhidian Huang, Zhengxiao Du, Xiao Liu, Aohan Zeng, Lei Hou, Yuxiao Dong, Jie Tang, Juanzi Li
ACL 2024
[paper] [code]

Benchmarking Foundation Models with Language-Model-as-an-Examiner
Yushi Bai*, Jiahao Ying*, Yixin Cao, Xin Lv, Yuze He, Xiaozhi Wang, Jifan Yu, Kaisheng Zeng, Yijia Xiao, Haozhe Lyu, Jiayin Zhang, Juanzi Li, Lei Hou
NeurIPS 2023
[paper] [website]

Answering Complex Logical Queries on Knowledge Graphs via Query Computation Tree Optimization
Yushi Bai, Xin Lv, Juanzi Li, Lei Hou
ICML 2023
[paper] [code]

SQUIRE: A Sequence-to-sequence Framework for Multi-hop Knowledge Graph Reasoning
Yushi Bai, Xin Lv, Juanzi Li, Lei Hou, Yincen Qu, Zelin Dai, Feiyu Xiong
EMNLP 2022 (Oral)
[paper] [code]

Envy-free and pareto-optimal allocations for agents with asymmetric random valuations
Yushi Bai, Paul Gölz
IJCAI 2022
[paper]

Fair allocations for smoothed utilities
Yushi Bai, Uriel Feige, Paul Gölz, Ariel Procaccia
ACM EC 2022
[paper]

Modeling heterogeneous hierarchies with relation-specific hyperbolic cones
Yushi Bai*, Rex Ying*, Hongyu Ren, Jure Leskovec
NeurIPS 2021
[paper] [code]

Experience
Tsinghua University
2022.08 - Present

Ph.D student in Computer Science and Technology
Advisor: Prof. Juanzi Li
Harvard University
2021.02-2021.09

Visiting Research Student
Advisor: Prof. Ariel Procaccia
Stanford University
2020.06-2020.10

Visiting Research Student
Advisor: Prof. Jure Leskovec
Tsinghua University
2018.08 - 2022.07

B.Eng. in Yao Class
Honors & Awards
  • Outstanding Undergraduate in Beijing, 2022
  • Yao Award, 2021
  • Tsinghua Comprehensive Excellence Scholarship, 2019, 2020, 2021

Template adapted from Jon Barron.