Skip to content

KAIST-VICLab/SLiM

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 

Repository files navigation

Less is More: Decoder-Free Masked Modeling for Efficient Skeleton Representation Learning

Jeonghyeok Do1     Yun Chen1     Geunhyuk Youk1     Munchurl Kim1†

Corresponding author
1Korea Advanced Institute of Science and Technology, South Korea

Official PyTorch implementation of "Less is More: Decoder-Free Masked Modeling for Efficient Skeleton Representation Learning".

SLiM (Skeleton Less is More) is a unified representation learning framework that bridges the gap between Masked Auto-Encoders (MAE) and Contrastive Learning (CL).

  • 🚀 Extreme Efficiency: A completely decoder-free architecture that reduces inference computational costs by 7.89×.
  • 🧠 Robust Representation: Introduces Semantic Tube Masking (STM) and Skeleton-Aware Augmentations (SAA) to capture anatomically consistent motion dynamics without shortcut learning.
  • 🏆 State-of-the-Art: Achieves peak performance across NTU-60, NTU-120, and PKU-MMD II benchmarks.

SLiM: Decoder-Free Unified Framework

motivation


Overview of SLiM Framework

overview


Less Cost, More Accuracy

table


📧 News

  • Mar 11, 2026: This repository is created

Reference

@article{do2026less,
  title={Less is More: Decoder-Free Masked Modeling for Efficient Skeleton Representation Learning},
  author={Do, Jeonghyeok and Chen, Yun and Youk, Geunhyuk and Kim, Munchurl},
  journal={arXiv preprint arXiv:2603.10648},
  year={2026}
}

Results

Please visit our project page for more experimental results.

Acknowledgements

This repository is built upon SkateFormer and TDSM.

Contributors