Jun Nie 聂俊
My research focuses on
LLM post-training,
LLM agents,
and
self-improving AI.
I study how language models and agents can continuously improve through
training, interaction, execution feedback, and experience accumulation.
My current work spans both
model-level self-improvement,
including label-free reinforcement learning and automated data-model optimization,
and
agent-level self-improvement,
including test-time and collaborative agent harness evolution.
I also work on agentic reinforcement learning for structured data reasoning,
including knowledge graph reasoning and Text-to-SQL.
Previously, I worked on AI-generated image detection and
out-of-distribution detection.
LLM Post-Training
LLM Agent
Self-Improving AI
Email:
nj123456@mail.ustc.edu.cn
Publications
NeurIPS 2026
Reasoning Warm-up: Scaling Label-free RL via Verifiable Surrogate Rewards
Jun Nie,
Bo Han,
Jiaqi Fan,
Yonggang Zhang,
Xinmei Tian,
Dahai Yu,
Michael Ng
NeurIPS 2026
Interactive Combinatorial Reinforcement Learning for Knowledge Graph Reasoning
Jun Nie,
Yonggang Zhang,
Tongliang Liu,
Chengqi Zhang,
Xinmei Tian,
Bo Han
NeurIPS 2025
Jun Nie,
Yonggang Zhang,
Tongliang Liu,
Yiu-ming Cheung,
Bo Han,
Xinmei Tian
NeurIPS 2025 · Spotlight
Yonggang Zhang,
Jun Nie,
Xinmei Tian,
Mingming Gong,
Kun Zhang,
Bo Han
ICLR 2024
Jun Nie,
Yonggang Zhang,
Zhen Fang,
Tongliang Liu,
Bo Han,
Xinmei Tian
IJCV 2025
Jun Nie,
Yadan Luo,
Shanshan Ye,
Yonggang Zhang,
Xinmei Tian,
Zhen Fang
arXiv 2026
Jun Nie,
Yonggang Zhang,
Tongliang Liu,
Yiu-ming Cheung,
Bo Han,
Xinmei Tian
Preprint
MedReason-Dx:
Benchmarking Step-by-Step Reasoning of Language Models in Medical Diagnosis
Jun Nie,
Xikun Zhang,
Michael K. Chen,
et al.
arXiv 2026
Jun Nie,
Yonggang Zhang,
Jun Song,
Qianshu Cai,
Dahai Yu,
Yike Guo,
Xinmei Tian,
Bo Han
arXiv 2026
Jun Nie,
Zhiqin Yang,
Zhenheng Tang,
Yonggang Zhang,
Xiaowen Chu,
Xinmei Tian,
Bo Han
arXiv 2026
Jun Nie,
Yonggang Zhang,
Qianshu Cai,
Yiu-ming Cheung,
Xinmei Tian,
Bo Han
arXiv 2026
Safe Harness Self-Evolution:
A Theoretical Analysis of Feasibility and Limits
Qianshu Cai,
Yonggang Zhang,
Jun Nie,
Maohao Ran,
Huajiang Zheng,
Jun Song,
Xinmei Tian,
Yike Guo,
Wei Xue
Academic Services
Conference Reviewer
ICLR, ICML, NeurIPS, ACM MM
Journal Reviewer
Machine Learning,
Computer Vision and Image Understanding,
Neural Processing Letters