MoE training for Me and You and maybe other people

A debugging and profiling tool that can trace and visualize python code execution

Helpful tools and examples for working with flex-attention

FFmpeg Assembly Language Lessons

A Quirky Assortment of CuTe Kernels

PyTorch Single Controller

🤗 LeRobot: Making AI for Robotics more accessible with end-to-end learning

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

C-Reduce, a C and C++ program reducer

Model Context Protocol Servers

Interactively inspect module inputs, outputs, parameters, and gradients.

The simplest, fastest repository for training/finetuning medium-sized GPTs.

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

A tool for working with stacked PRs on github.

This repository contains the experimental PyTorch native float8 training UX

Deep inspection of Python objects

Master programming by recreating your favorite technologies from scratch.

🔍 A Hex Editor for Reverse Engineers, Programmers and people who value their retinas when working at 3 AM.

Collaborative Collection of C++ Best Practices. This online resource is part of Jason Turner's collection of C++ Best Practices resources. See README.md for more information.

Count your code, quickly.

Tile primitives for speedy kernels

Improved build system generator for CPython C, C++, Cython and Fortran extensions

Distribute and run LLMs with a single file.

This is the Rust course used by the Android team at Google. It provides you the material to quickly teach Rust.

Puzzles for learning Triton

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference