DLRover: An Automatic Distributed Deep Learning System

XLA Launcher is a high-performance, lightweight C++ library designed to provide a simple interface for loading and executing computation graphs represented in the StableHLO format.

Some resources about Ray Forward Meetup

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

Material for Ray Connect 2024 Conference

all of the workflows of n8n i could find (also from the site itself)

Incremental garbage collection from safe Rust

This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

Discrete Diffusion Forcing (D2F): dLLMs Can Do Faster-Than-AR Inference

A blazing fast inference solution for text embeddings models

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Low-code framework for building custom LLMs, neural networks, and other AI models

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

slime is an LLM post-training framework for RL Scaling.

✔（已完结）超级全面的 深度学习 笔记【土堆 Pytorch】【李沐 动手学深度学习】【吴恩达 深度学习】【大飞 大模型Agent】

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. AntRay is forked from ray, offering incremental new features on top …

Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible.

Mamba SSM architecture

RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.

A Datacenter Scale Distributed Inference Serving Framework

verl: Volcano Engine Reinforcement Learning for LLMs

Cost-efficient and pluggable Infrastructure components for GenAI inference

🚀✨ Minimalistic, powerful and extremely customizable Zsh prompt

Patched fonts for Powerline users.

🙃 A delightful community-driven (with 2,400+ contributors) framework for managing your zsh configuration. Includes 300+ optional plugins (rails, git, macOS, hub, docker, homebrew, node, php, python…

learning how CUDA works