About Me
I am a Ph.D. student in the EECS department at UC Berkeley advised by Professor Dawn Song. Before joining UC Berkeley, I received my bachelor’s degree from ACM Honors Class, Shanghai Jiao Tong University. I am a member of Berkeley Center for Responsible, Decentralized Intelligence (RDI), Initiative for Cryptocurrencies & Contracts Lab (IC3), and Berkeley Artificial Intelligence Research (BAIR) Lab.
- Research Interest: I am broadly interested in computer security, systems, and machine learning, especially building systems that enable secure and privacy-preserving data processing or solve real-world security problems.
News
- Apr 2026: Coding agents are facinating, here’s BotDock, a recent tool we build (with coding agent) for agent session management.
- Aug 2025: Our AgentCTF Competition has been accepted by IEEE SaTML 2026.
- Mar 2025: “FHE-based SQL aggregation across millions of records within a minute.” Check out our paper accepted to VLDB 2025.
- Jan 2024: Presenting on Decentralized LLM serving at IC3 Winter Retreat.
- Jul 2023: Honored to be supported by the JP Morgan Chase PhD Fellowship 2023.
Publications
-
Agents' Last Exam [pdf]
Yiyou Sun, Xinyang Han, Weichen Zhang, Yuanbo Pang, Tianyu Wang, Yuhan Cao, Yixiao Huang, Chris Duroiu, Haoyun Zhang, Jeffrey Lin, Weishu Zhang, Tyler Zeng, Ying Yan, Bo Liu, Hanson Wen, Mingyang Xu, Xiaoyuan Liu, Zimeng Chen, Weiyan Shi, Amanda Dsouza, Vincent Sunn Chen, Dawn Song
-
Position: Agent Evaluation Should Be Agentified for Openness, Standardization, and Reproducibility [pdf]
Xiaoyuan Liu, Tianneng Shi, Wenbo Guo, Dawn Song
[ICML 2026] -
The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey [pdf]
Juhee Kim, Xiaoyuan Liu, Zhun Wang, Shi Qiu, Bo Li, Wenbo Guo, Dawn Song
-
Measuring Agents in Production [pdf]
Melissa Z Pan, Negar Arabzadeh, Riccardo Cogo, Yuxuan Zhu, Alexander Xiong, Lakshya A Agrawal, Huanzhi Mao, Emma Shen, Sid Pallerla, Liana Patel, Shu Liu, Tianneng Shi, Xiaoyuan Liu, Jared Quincy Davis, Emmanuele Lacavalla, Alessandro Basile, Shuyi Yang, Paul Castro, Daniel Kang, Joseph E Gonzalez, Koushik Sen, Dawn Song, Ion Stoica, Matei Zaharia, Marquita Ellis
-
Can LLMs Ask Good Questions? [pdf]
Yueheng Zhang*, Xiaoyuan Liu* (equal contribution), Yiyou Sun, Atheer Alharbi, Hend Alzahrani, Basel Alomair, Dawn Song
-
Xiaoyuan Liu, Ni Trieu, Trinabh Gupta, Ishtiyaque Ahmad, Dawn Song
[VLDB 2025] (Invited to the “Best of VLDB 2025” Special Issue) -
ThreatKG: An AI-Powered System for Automated Open-Source Cyber Threat Intelligence Gathering and Management [pdf]
Peng Gao*, Xiaoyuan Liu* (equal contribution), Edward Choi, Sibo Ma, Xinyu Yang, Dawn Song
[LAMPS 2024] -
Ratel: MPC-extensions for Smart Contracts [pdf]
Yunqi Li, Kyle Soska, Zhen Huang, Sylvain Bellemare, Mikerah Quintyne-Collins, Lun Wang, Xiaoyuan Liu, Dawn Song, Andrew Miller
[Asia CCS 2024] -
Evaluating Large Language Models in an Emerging Domain: A Pilot Study in Decentralized Finance [pdf]
Joshua Carter Pearlson, Xiaoyuan Liu, Chengsong Huang, Kripa Ann George, Dawn Song, Chenguang Wang
[ICLR 2024 Workshop] -
Effective and Efficient Federated Tree Learning on Hybrid Data [pdf]
Qinbin Li, Chulin Xie, Xiaojun Xu, Xiaoyuan Liu, Ce Zhang, Bo Li, Bingsheng He, Dawn Song
[ICLR 2024] -
Lessons Learned: Surveying the Practicality of Differential Privacy in the Industry [pdf]
Gonzalo Munilla Garrido, Xiaoyuan Liu, Florian Matthes, Dawn Song
[PETS 2023] -
UniFed: A Benchmark for Federated Learning Frameworks [pdf]
Xiaoyuan Liu, Tianneng Shi, Chulin Xie, Qinbin Li, Kangping Hu, Haoyu Kim, Xiaojun Xu, Bo Li, Dawn Song
-
Peng Gao*, Xiaoyuan Liu* (equal contribution), Edward Choi, Bhavna Soman, Chinmaya Mishra, Kate Farris, Dawn Song
[SIGMOD 2021 demo] -
Enabling Efficient Cyber Threat Hunting With Cyber Threat Intelligence [pdf]
Peng Gao, Fei Shao, Xiaoyuan Liu, Xusheng Xiao, Zheng Qin, Fengyuan Xu, Prateek Mittal, Sanjeev R Kulkarni, Dawn Song
[ICDE 2021] -
A System for Efficiently Hunting for Cyber Threats in Computer Systems Using Threat Intelligence [pdf] [video]
Peng Gao, Fei Shao, Xiaoyuan Liu, Xusheng Xiao, Haoyuan Liu, Zheng Qin, Fengyuan Xu, Prateek Mittal, Sanjeev R Kulkarni, Dawn Song
[ICDE 2021 demo] -
BeeTrace: A Unified Platform for Secure Contact Tracing that Breaks Data Silos [pdf]
Xiaoyuan Liu, Ni Trieu, Evgenios M Kornaropoulos, Dawn Song
[IEEE Data Engineering Bulletin 2020] -
Distributed Structured Actor-Critic Reinforcement Learning for Universal Dialogue Management [pdf]
Zhi Chen, Lu Chen, Xiaoyuan Liu, Kai Yu
[IEEE/ACM Transactions on Audio, Speech, and Language Processing] -
Dan Hendrycks*, Xiaoyuan Liu* (equal contribution), Eric Wallace, Adam Dziedzic, Rishabh Krishnan, Dawn Song
[ACL 2020] -
Structured Hierarchical Dialogue Policy with Graph Neural Networks
Zhi Chen, Xiaoyuan Liu, Lu Chen, Kai Yu
Professional Services
- Artifact Evaluation Committee - OSDI 2026
- Program Committee - COLING 2025
- Program Committee - NIPS 2024
- Program Committee - FLSys (MLSys workshop) 2023
- ERC, Session Chair (Correctness and Security) - MLSys 2023
- Program Committee - ACL 2023
- Program Committee - EMNLP 2023, 2022, 2021
- Program Committee - CCS 2022
- Coordination Committee - Responsible Data Summit 2020
Selected Projects
- AgentBeats [Overview] [Competition]
- CoLearn/CoLink: A Generic Programming Framework for Federated and Decentralized Data Science [Homepage] [Talk at NeurIPS 2022 workshop]
- MPC4F (Multi-Party Computation for Fairness) [News (Meta AI)] [News (Oasis Lab)]
Education
UC Berkeley
Ph.D. Student, EECS
2020 - 2026 (Expected)
Shanghai Jiao Tong University
Honors Bachelor of Engineering (B.Eng. Hons) in Computer Science
2016 - 2020
Honors
- RDI Frontier Fellowship [2024]
- JP Morgan Chase PhD Fellowship [2023]
- Berkeley EECS Department Fellowship [2020]
- Shanghai Excellent Graduate [2020]
- Outstanding Student Cadre (Top 0.8%, SJTU) [2018]
- Academic Excellence Scholarship [2017, 2018, 2019]
- Zhiyuan Honorary Scholarship [2016, 2017, 2018, 2019]
- KoGuan Encouragement Scholarship (Top 0.3%, SJTU) [2017]
- The 32nd China’s National Olympiad in Informatics (NOI) Silver Medal [2015]
Misc
Materials
Teaching Experience
- Teaching Assistant Entrepreneurship In Web3 - Fall 2022
- Teaching Assistant Decentralized Finance - Fall 2021
- Student Instructor Principle and Practice of Computer Algorithms - Summer 2018
- Lead Teaching Assistant Data Structures - Spring 2018
- Lead Teaching Assistant C++ Programming (A) - Fall 2017
Activities
- Student Council Vice President, Zhiyuan College, SJTU - 2018
- Head of the Department of Culture and Sports, Student Union, Zhiyuan College, SJTU - 2017