Portrait of Dongchen Han

Dongchen Han

Tsinghua University

Beijing, China

hdc23@mails.tsinghua.edu.cn

I am a Ph.D. candidate at Tsinghua University, advised by Prof. Gao Huang at LeapLab. I received my B.Eng. from Tsinghua University in 2023. I am currently a Top Seed Intern at ByteDance Seed.

My research centers on efficient and scalable architecture design, with a focus on test-time training, sequence modeling, context scaling, and continual learning. My work ViT3: Unlocking Test-Time Training in Vision was selected as a CVPR 2026 Best Paper Finalist (15 / 16,092 submissions) and an Oral presentation.

News

Oct 2026 🏆 Honored to receive the National Scholarship for the second consecutive year, in 2026!
Jun 2026 🏆 Our paper ViT3: Unlocking Test-Time Training in Vision is a CVPR 2026 Best Paper Finalist (15 / 16,092 submissions) and an Oral presentation!
May 2026 🎉 Two papers were accepted at ICML 2026!
Jan 2026 ✨ I joined ByteDance Seed as a Top Seed Intern, working on LLM architecture research with a focus on context scaling and continual learning.
Oct 2025 🏆 Honored to receive the National Scholarship in 2025!

Selected Publications

  1. CVPR
    ViT3.png
    ViT3: Unlocking Test-Time Training in Vision
    Dongchen Han, Yining Li, Tianyu Li, and 6 more authors
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026
    OralBest Paper Finalist15/16092
  2. ICML
    SiameseNorm.png
    SiameseNorm: Breaking the Barrier to Reconciling Pre/Post-Norm
    Tianyu Li*, Dongchen Han*, Zixuan Cao, and 7 more authors
    In International Conference on Machine Learning (ICML), 2026
  3. ICML
    Linearizing.png
    Linearizing Vision Transformer with Test-Time Training
    Yining Li*, Dongchen Han*, Zeyu Liu*, and 3 more authors
    In International Conference on Machine Learning (ICML), 2026
  4. AAAI
    Circulant.png
    Vision Transformers are Circulant Attention Learners
    Dongchen Han*, Tianyu Li*, Ziyi Wang, and 1 more author
    In AAAI Conference on Artificial Intelligence (AAAI), 2026
  5. NeurIPS
    MILA.png
    Demystify Mamba in Vision: A Linear Attention Perspective
    Dongchen Han, Ziyi Wang, Zhuofan Xia, and 7 more authors
    In Advances in Neural Information Processing Systems (NeurIPS), 2024
  6. NeurIPS
    InLine.png
    Bridging the Divide: Reconsidering Softmax and Linear Attention
    Dongchen Han*, Yifan Pu*, Zhuofan Xia*, and 6 more authors
    In Advances in Neural Information Processing Systems (NeurIPS), 2024
  7. ECCV
    Agent.png
    Agent Attention: On the Integration of Softmax and Linear Attention
    Dongchen Han*, Tianzhu Ye*, Yizeng Han, and 3 more authors
    In European Conference on Computer Vision (ECCV), 2024
  8. CVPR
    GSVA.png
    GSVA: Generalized Segmentation via Multimodal Large Language Models
    Zhuofan Xia*, Dongchen Han*, Yizeng Han, and 3 more authors
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
  9. ICCV
    FLatten.png
    FLatten Transformer: Vision Transformer using Focused Linear Attention
    Dongchen Han*, Xuran Pan*, Yizeng Han, and 2 more authors
    In IEEE/CVF International Conference on Computer Vision (ICCV), 2023
  10. ICCV
    Dyn_Perceiver.png
    Dynamic Perceiver for Efficient Visual Recognition
    Yizeng Han*, Dongchen Han*, Zeyu Liu, and 7 more authors
    In IEEE/CVF International Conference on Computer Vision (ICCV), 2023

Internship Experience

  • Top Seed Intern
    2026.01 – Present
    ByteDance Seed
    • Research on large language model architectures, focusing on context scaling and continual learning.
  • Research Intern
    2024.05 – 2025.12
    Alibaba Future Life Lab
    • Research on advanced efficient sequence modeling mechanisms.

Honors and Awards

2026
  • CVPR 2026 Best Paper Finalist · 15 of 16,092 submissions
  • National Scholarship · 国家奖学金
2025
  • National Scholarship · 国家奖学金
2023
  • Outstanding Graduate of Tsinghua University · 清华大学优秀毕业生
  • Outstanding Graduate of Beijing Municipality · 北京市优秀毕业生
  • Outstanding Undergraduate Thesis, Tsinghua University · 清华大学优秀本科毕业论文
  • Future Scholar Scholarship, Tsinghua University · 清华大学未来学者奖学金
2022
  • SenseTime Scholarship · 商汤奖学金
  • Jiang Nanxiang Scholarship · 蒋南翔奖学金
  • Outstanding Student Cadre of Tsinghua University · 清华大学优秀学生干部
2021
  • Jiang Nanxiang Scholarship · 蒋南翔奖学金
2020
  • National Scholarship · 国家奖学金
  • First Prize, College Physics Competition · 大学生物理竞赛一等奖
2019
  • Second-Class Freshman Scholarship, Tsinghua University · 清华大学新生二等奖学金(高考全省前 10 名)