Jun Nie 聂俊

I'm a Ph.D. student at the School of Information Science and Technology, University of Science and Technology of China (USTC) , supervised by Prof. Xinmei Tian . I'm currently a visiting Ph.D. student at the TMLR Group , Hong Kong Baptist University (HKBU) , working closely with Prof. Bo Han and Prof. Yonggang Zhang .
My research focuses on LLM post-training, LLM agents, and self-improving AI. I study how language models and agents can continuously improve through training, interaction, execution feedback, and experience accumulation. My current work spans both model-level self-improvement, including label-free reinforcement learning and automated data-model optimization, and agent-level self-improvement, including test-time and collaborative agent harness evolution. I also work on agentic reinforcement learning for structured data reasoning, including knowledge graph reasoning and Text-to-SQL. Previously, I worked on AI-generated image detection and out-of-distribution detection.
LLM Post-Training LLM Agent Self-Improving AI
Email: nj123456@mail.ustc.edu.cn

Education

2022.09 — Present

Ph.D. Student · University of Science and Technology of China (USTC)

School of Information Science and Technology
Supervisor: Prof. Xinmei Tian
2018.09 — 2022.06

B.E. · University of Science and Technology of China (USTC)

School of Information Science and Technology

Experience

2025.03 — Present

Visiting Ph.D. Student · TMLR Group , Hong Kong Baptist University

Supervisor: Prof. Bo Han · Research focus: LLM Post-Training, Agentic RL, and Self-Improving Agents
2022.09 — Present

Ph.D. Research · University of Science and Technology of China (USTC)

Supervisor: Prof. Xinmei Tian · Research focus: LLM Agents, Reinforcement Learning, AI-Generated Image Detection, and Out-of-Distribution Detection

Publications

NeurIPS 2026
Reasoning Warm-up: Scaling Label-free RL via Verifiable Surrogate Rewards
Jun Nie, Bo Han, Jiaqi Fan, Yonggang Zhang, Xinmei Tian, Dahai Yu, Michael Ng
NeurIPS 2026
Interactive Combinatorial Reinforcement Learning for Knowledge Graph Reasoning
Jun Nie, Yonggang Zhang, Tongliang Liu, Chengqi Zhang, Xinmei Tian, Bo Han
NeurIPS 2025
Jun Nie, Yonggang Zhang, Tongliang Liu, Yiu-ming Cheung, Bo Han, Xinmei Tian
NeurIPS 2025 · Spotlight
Yonggang Zhang, Jun Nie, Xinmei Tian, Mingming Gong, Kun Zhang, Bo Han
ICLR 2024
Jun Nie, Yonggang Zhang, Zhen Fang, Tongliang Liu, Bo Han, Xinmei Tian
IJCV 2025
Jun Nie, Yadan Luo, Shanshan Ye, Yonggang Zhang, Xinmei Tian, Zhen Fang
arXiv 2026
Jun Nie, Yonggang Zhang, Tongliang Liu, Yiu-ming Cheung, Bo Han, Xinmei Tian
Preprint
MedReason-Dx: Benchmarking Step-by-Step Reasoning of Language Models in Medical Diagnosis
Jun Nie, Xikun Zhang, Michael K. Chen, et al.
arXiv 2026
Jun Nie, Yonggang Zhang, Jun Song, Qianshu Cai, Dahai Yu, Yike Guo, Xinmei Tian, Bo Han
arXiv 2026
Jun Nie, Zhiqin Yang, Zhenheng Tang, Yonggang Zhang, Xiaowen Chu, Xinmei Tian, Bo Han
arXiv 2026
Jun Nie, Yonggang Zhang, Qianshu Cai, Yiu-ming Cheung, Xinmei Tian, Bo Han
arXiv 2026
Safe Harness Self-Evolution: A Theoretical Analysis of Feasibility and Limits
Qianshu Cai, Yonggang Zhang, Jun Nie, Maohao Ran, Huajiang Zheng, Jun Song, Xinmei Tian, Yike Guo, Wei Xue

Awards & Honors

Academic Services

Conference Reviewer

ICLR, ICML, NeurIPS, ACM MM

Journal Reviewer

Machine Learning, Computer Vision and Image Understanding, Neural Processing Letters