🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite

Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (V…

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

Let us control diffusion models!

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

Graph Neural Network Library for PyTorch

Datasets, Transforms and Models specific to Computer Vision

Train transformer language models with reinforcement learning.

Ongoing research training transformer models at scale

Python Imaging Library (Fork)

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Go ahead and axolotl questions

PyTorch3D is FAIR's library of reusable components for deep learning with 3D data

Accessible large language models via k-bit quantization for PyTorch.

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

Open Source Neural Machine Translation and (Large) Language Models in PyTorch

s1: Simple test-time scaling

Repo for external large-scale work

Code release for ConvNeXt model

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

PyTorch native post-training library

A PyTorch native platform for training generative AI models

Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.

AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

An open-source framework for training large multimodal models.

Run PyTorch LLMs locally on servers, desktop and mobile