The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

[ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2

A PyTorch native platform for training generative AI models

An interference-aware scheduler for fine-grained GPU sharing

NVIDIA Linux open GPU kernel module source

Easy and Efficient dLLM Fine-Tuning

LM engine is a library for pretraining/finetuning LLMs

LaTeX Template for Statement of Purpose (SoP)

dInfer: An Efficient Inference Framework for Diffusion Language Models

[SIGMOD 2025] PQCache: Product Quantization-based KVCache for Long Context LLM Inference

Pie: Programmable LLM Serving

An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models

kernels, of the mega variety

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

libsmctrl论文的复现，添加了python端接口，可以在python端灵活调用接口来分配计算资源

DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference

Documentation of NVIDIA chip/hardware interfaces

Effective transpose on Hopper GPU

📄 Awesome CV is LaTeX template for your outstanding job application

Port of OpenAI's Whisper model in C/C++

VoiceTrans是一站式离线AI视频字幕生成和翻译软件，功能包括视频下载，音频提取，听写打轴，字幕翻译，视频合成，字幕总结。

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Automatically generate, translate, and overlay subtitles for any video.

Automatically generate and overlay subtitles for any video.