Quanzhou / Fuzhou, China

Shizhao Gao

I study what video-language models actually need to see — and how to make them pay for only that.

  • CVPR 2026 Findings · First Author
  • CVPR Compute Gold Star · Top 5%
  • Chinese Academy of Sciences
8
Papers
4 as first author
0.129
MAE on RepCount
Label-free SOTA, beats supervised
18.0%
FLOPs saved
VideoLLM routing, near-baseline accuracy
100+
Engineering projects
Server platforms delivered, ¥30M orders
Research

Three questions I keep returning to

01

Repetitive Action Counting

Teaching models to count repetitions with no count labels at all. Real motion speeds up and slows down mid-video, which quietly breaks the fixed-period assumption almost every prior method rests on. I model period adaptively across multiple temporal scales, so the structure of repetition is learned rather than assumed.

  • Self-supervised learning
  • Temporal cycle consistency
  • Multi-scale modeling
  • Period adaptation
02

Skeleton-Based Action Understanding

Skeleton representations inherit whatever the camera happened to be doing. I use gravity as a stable external reference to decouple viewpoint from motion semantics, and model anomaly as a relational property — because what makes one person's behaviour abnormal is usually the people around them.

  • View-robust recognition
  • Gravity-aware decoupling
  • Multi-person anomaly
  • Graph modeling
03

Efficient Video-Language Inference

Most VideoLLM pipelines sample frames densely or on a fixed budget, with no evidence that the frames are sufficient. I measure minimum sufficient frame sets directly, then route uncertain examples to larger budgets — spending compute where the model is actually unsure, and reporting plainly where the strategy fails to transfer.

  • Frame sufficiency
  • Confidence routing
  • Visual token masking
  • FLOP profiling
Publications

Selected publications

Published

Under review & revision

IEEE TMC CCF-A

Resource-aware on-device repetition sensing for mobile edge devices

First author · Sole student author

Under review
IJCV CCF-A

Semantic-guided representation decoupling for self-supervised repetitive counting

Student co-author · Sole student author

Under review
AAAI 2027 CCF-A

View-robust skeleton action recognition

First author · Sole student author

Under review
AAAI 2027 CCF-A

Multi-person skeleton anomaly detection

First author · Sole student author

Under review
Pattern Recognition JCR Q1

Temporal cycle consistency with dynamic thresholding for robust counting

Student co-author

Revision submitted
Pattern Recognition JCR Q1

Global multi-geometric feature learning for repetitive counting

Student co-author

Revision submitted
IEEE TCSVT JCR Q1

Flexible graph-based modeling with adaptive node interaction

Student co-author

Under review

Titles are withheld while under review, in line with double-blind policy. Full details available on request or in my CV.

Projects

Work in depth

M.Eng. thesis project · Lead

Period-Adaptive Self-Supervised Repetitive Action Counting

Sep 2024 — Present
  • RepCount 0.129 MAE · 0.842 OBO
  • Countix 0.098 MAE · 0.879 OBO
The problem

Prior repetitive-counting methods assume a fixed period per video. Real actions accelerate and decelerate mid-sequence, so that assumption fails exactly where counting matters most — and most methods additionally require dense count annotations.

Approach

Period-adaptive multi-scale temporal cycle consistency paired with an action-similarity objective, learning repetition structure from unlabeled skeleton sequences, and a multi-expert consensus stage that turns learned structure into a count.

Outcome

Published at CVPR 2026 Findings and awarded a CVPR Compute Gold Star. I led problem formulation, method design, the full PyTorch implementation, all experiments and ablations, and the manuscript.

Independent research · Open source

Frame Sufficiency & Adaptive Routing for VideoLLMs

2026
  • Qwen2.5-VL −18.0% FLOPs, near-baseline accuracy
  • LLaVA-Video Did not transfer — reported as a limit
The problem

VideoLLM evaluation samples frames densely or on a fixed budget. Nobody checks whether those frames are sufficient — so compute is spent uniformly on questions of wildly different difficulty.

Approach

Measured minimum sufficient frame sets across 1,336 LongVideoBench validation examples on Qwen2.5-VL and LLaVA-Video, then built visual-token masking, answer-option scoring, and nested confidence routing that escalates only uncertain examples to larger frame budgets.

Outcome

Shipped as a reproducible package: model adapters, automated tests, CI, sanitized experiment artifacts, and full data/licensing documentation. The negative transfer result is reported as prominently as the positive one — a cross-model boundary is a finding, not a failure.

CAS Project 2024QZC001R · Core member

Skeleton-Based Action Understanding

Sep 2024 — Present
  • Contribution Shared preprocessing, spatiotemporal representation, training & evaluation pipelines
The problem

Skeleton action representations are entangled with the camera coordinate frame, so recognition degrades under viewpoint change. And multi-person anomaly detection typically scores each person in isolation, discarding the social context that defines abnormality.

Approach

Gravity-aware view decoupling with adaptive feature modulation to strip camera dependence while preserving motion semantics; and gated, dynamic inter-person dependency modeling so that social context can shape the anomaly score.

Outcome

The two methodological directions led to two AAAI 2027 submissions, both as first author.

Engineering

Not only a researcher

Before research, I shipped. Nearly two years as a product engineer on enterprise server platforms, then a product-management stint on a bank financial-guarantee system, and a student software company I ran through my undergraduate degree. That background is why my research ships with tests, CI, and a cost model rather than a folder of scripts.

Wuhan Yangtze Computing Technology

Product Engineer Jun 2022 — Jan 2024
  • Translated customer technical specifications into server configurations, product adaptation plans, validation programs, and delivery schemes across 100+ enterprise and public-sector projects.
  • Led compatibility validation and system integration for high-density computing platforms, coordinating R&D, supply chain, quality, manufacturing, and sales.
  • The platform I drove through product introduction reached ¥30M in initial order volume.
  • Server platforms
  • System integration
  • Hardware validation
  • Cross-team delivery

Fujian Tianhe Zhongcheng Technology

Product Manager (Intern) Oct 2024 — Apr 2025
  • Designed process flows, business rules, role-permission models, and exception handling for a bank electronic financial-guarantee product, converting business needs into structured requirements, functional boundaries, and acceptance criteria.
  • Coordinated product, engineering, and business teams through design review, integration testing, acceptance, and launch — delivered one month ahead of schedule with no major production defects.
  • Requirements design
  • FinTech
  • Access control
  • Release management

Jiuli (Wuhan) Software — student venture

Founder & Lead 2018 — 2022
  • Ran an on-campus software venture end to end: sourcing and scoping outsourced projects, allocating the team, and shipping mini-programs, websites, and management systems as a hands-on developer.
  • Full-stack
  • Mini-program
  • Team leadership
  • Client delivery
References

What my supervisors say

He independently identified the bottleneck in variable-speed action sequences, conceived the mitigation strategy, and drove the implementation to completion — demonstrating the intellectual autonomy essential for doctoral research.
Among the master’s researchers I have worked with in recent years, he stands out for his combination of initiative, follow-through, and consideration for colleagues.

Prof. Jun Li

Professor

Quanzhou Institute of Equipment Manufacturing, Haixi Institute, CAS

Primary research supervisor since Sep 2024

Read the full letter
Across these projects, he has demonstrated the full cycle of problem definition, implementation, deployment, evaluation, and revision.
He is willing to resolve infrastructure issues that affect the wider group, even when they are not part of his own immediate experiments.

Assoc. Prof. Qiming Li

Associate Professor

Quanzhou Institute of Equipment Manufacturing, Haixi Institute, CAS

Day-to-day supervisor; corresponding author on all current papers

Read the full letter
About

Background

Portrait of Shizhao Gao

M.Eng. candidate in Artificial Intelligence, jointly trained at the Quanzhou Institute of Equipment Manufacturing, Chinese Academy of Sciences. My research asks how far video understanding can go without labels and without waste: self-supervised temporal modeling that learns repetition structure on its own, and inference strategies that spend compute only where a model actually needs it. Right now I'm most interested in adaptive visual-token allocation, efficient multimodal reasoning, and whether efficiency gains actually transfer across video-language architectures under realistic compute budgets. Before returning to research I spent nearly two years as a product engineer shipping server platforms at enterprise scale — that engineering instinct still shapes how I build: reproducible pipelines, measured cost, honest negative results.

Education

Fujian Agriculture and Forestry University

Sep 2024 — Jun 2027 (expected)

M.Eng. in Artificial Intelligence

College of Mechanical and Electrical Engineering · Fuzhou / Quanzhou, China

Jointly trained at the Quanzhou Institute of Equipment Manufacturing, Haixi Institute, Chinese Academy of Sciences

Thesis: Research on Weakly Supervised Repetitive Action Counting Methods Based on Action Similarity. Advisors: Prof. Jun Li and Assoc. Prof. Qiming Li. Ranked top 10% in comprehensive assessment.

South-Central Minzu University

Sep 2018 — Jun 2022

B.Eng. in Software Engineering

School of Computer Science · Wuhan, China

Ranked top 10% in comprehensive assessment. Multiple academic scholarships; provincial awards in the "Internet+" and "Challenge Cup" innovation competitions. Led an on-campus software venture throughout the degree.

Service & Mentoring

Peer Review

Reviewer for Image and Vision Computing, 2026.

Undergraduate Mentoring

Mentored capstone thesis students through problem scoping, method selection, experiment planning, and technical writing.

Intern Supervision

Supervised interns on research software development and conference-paper preparation — task decomposition, coding milestones, experimental reporting, manuscript feedback.

Lab Infrastructure

Maintain shared GPU servers and coordinate compute allocation across the group, keeping team workflows reproducible.

Honors & Awards

2026 CVPR Compute Gold Star — top 5% across Main Track and Findings
2025 Academic Scholarship, Chinese Academy of Sciences
2025 Third Prize, "Huawei Cup" China Graduate Mathematical Contest in Modeling — Team Leader
2018–2022 Undergraduate academic scholarships; provincial third prizes in "Internet+" and "Challenge Cup"

Technical Skills

Video & Multimodal Models

  • Qwen2.5-VL
  • LLaVA-Video
  • InternVL
  • Transformers
  • LongVideoBench
  • Frame scaling
  • Confidence routing
  • FLOP profiling

Deep Learning & Vision

  • PyTorch
  • MMAction2
  • OpenCV
  • NumPy
  • Pandas
  • Self-supervised learning
  • Temporal modeling
  • Pose & skeleton analysis

Systems & Deployment

  • Python
  • C++
  • Linux
  • Git
  • Docker
  • CUDA
  • ONNX
  • TensorRT
  • nginx
  • CI/CD

Product & Delivery

  • Requirements engineering
  • Technical specification
  • Acceptance testing
  • Cross-team coordination
  • Full-stack web
  • Mini-program

Certifications & Languages

  • Software Design Engineer — China Computer Technology and Software Professional Qualification (Intermediate)
  • English — professional working proficiency in technical documentation, academic reading and research writing
Why a Ph.D.

I'm not setting out to change the world. I would like to move one field — a little, and in the right direction — and leave behind work that other people can pick up and build on. That is the whole reason I want to do a Ph.D.

Contact

Get in touch

gsz1999@fafu.edu.cn

I read every email. If you are a prospective advisor, a collaborator, or simply curious about the work, write to me directly.

Applying for Ph.D. positions starting 2027 · Open to research collaborations