PhD student · CISE · University of Florida

Yuning Han

Making large language model inference fast and practical under real memory budgets.

Profile avatar (illustration)

I'm a PhD student in Computer & Information Science & Engineering at the University of Florida, advised by Dr. Jingwei Sun. I work on speculative decoding for memory-limited LLM inference on edge devices, and previously on backdoor attacks against diffusion models.

Research interests

  • Efficient LLM Inference
  • Speculative Decoding
  • On-Device & Edge AI
  • Diffusion Models
  • AI Security
LatentSift verification pipeline: expert bank buildup during policy training, candidate pickup at inference, verification token-cost comparison, and score aggregation with channel fusion
Verification pipeline and token-cost comparison · open full size ↗

arXiv 2026 In Submission

LatentSift: Policy-State Filtering for Token-Efficient Verification of Software Engineering Agents

Yuning Han, Yangchenchen Jin, Tyler Jandreau, Jingwei Sun

Verifying the many candidate trajectories a software engineering agent generates at test time can cost as many tokens as generating them. LatentSift replaces the LLM-based first verification stage with a token-free, execution-free filter over hidden states the policy already produced — reasoning, observation and function-call states compared against banks from successful and unsuccessful training trajectories. On SWE-bench Verified, hybrid Best@16 matches or improves on each agent's reference workflow.

62.1%
Fewer total verification tokens at K = 16 · 66.6–81.0% fewer LLM-verifier tokens
Where the verification tokens go, stage by stage · static figure ↗
CATS cascaded adaptive tree speculation framework overview
Framework overview · open full size ↗

arXiv 2026 In Submission

CATS: Cascaded Adaptive Tree Speculation for Memory-Limited LLM Inference Acceleration

Yuning Han, Yangchenchen Jin, Dylan Zhao, Jingwei Sun

A self-speculative decoding framework for memory-limited LLM inference on edge devices: a lightweight draft adapter proposes a candidate token tree, a shallow verifier cheaply prunes it, and the target model confirms the survivors in a single pass — cutting target-model forward calls without raising peak memory.

5.08×
Wall-clock speedup, no loss in generation quality · up to 1.45× over prior SOTA
The full verification loop, left to right · static figure ↗
UIBDiffusion trigger generation and forward/backward diffusion process
Trigger generation and the forward / backward diffusion process · open full size ↗

CVPR 2025

UIBDiffusion: Universal Imperceptible Backdoor Attack for Diffusion Models

Yuning Han, Bingyin Zhao, Rui Chu, Feng Luo, Biplab Sikdar, Yingjie Lao

A universal, imperceptible backdoor trigger for diffusion models built from universal adversarial perturbations: image- and model-agnostic, it drives a high attack success rate on triggered inputs while keeping generation quality high on clean data, and evades state-of-the-art backdoor defenses (Elijah, TERD).

A backdoored model decoding clean and triggered noise, side by side
  1. Aug 2025 – Present

    Ph.D. in Computer Science

    University of Florida

  2. Sept 2023 – Feb 2025

    M.S. in Electrical Engineering

    Columbia University

  3. Sept 2019 – Jun 2023

    B.S. in Information Engineering

    Shanghai Jiao Tong University