Skip to content

Neul Labs

Building software, ML infrastructure, and developer tooling out in the open. Our repos start life as public R&D projects, then graduate into commercial platforms once the architecture is proven.

How We Work

  • Learning in public – roadmaps, RFCs, and field notes land in the repos, not private docs.
  • Docs-first – every project ships with a microsite, API references, and upgrade guides.
  • Operational by default – telemetry hooks, CI templates, and release automation are part of the starter kit.

Focus Areas

Discipline What we publish
Developer Tooling Prompt ops, background workers, CLI stacks, and SDK ergonomics.
ML Infrastructure Rust/Python accelerators for LangGraph, LiteLLM, CrewAI, and on-device inference.
Operational Excellence Control planes, observability defaults, workflows for release/telemetry hygiene.

Featured Projects

  • fast-litellm – Rust accelerators for LiteLLM routing, rate limiting, and pooling.
  • fast-crewai – Drop-in shims that speed up CrewAI memory + storage 2-5x.
  • fast-langgraph – Cache + checkpoint primitives for LangGraph, written in Rust.
  • fastworker – Brokerless task queues plus a control plane/GUI for Python apps.
  • savanty – Constraint-solving assistant that turns natural language specs into provable schedules.

Join the Work

  • Clone a repo, open an issue, or drop a PR. We review fast and treat community contributions just like internal work.
  • Want to commercialize or extend a project with us? Email hello@neul-labs.com.
  • Follow along via our website and the “Lab Notes” blog for architecture updates.

Neul Labs Ltd. • Edinbuirgh, United Kingdom

Pinned Loading

  1. fast-litellm fast-litellm Public

    High-performance Rust acceleration for LiteLLM - providing significant performance improvements for connection pooling, rate limiting, and memory-intensive workloads.

    Python 29 2

  2. fast-langgraph fast-langgraph Public

    High-performance Rust accelerators for LangGraph applications. Drop-in components that provide up to 700x speedups for checkpoint operations and 10-50x speedups for state management.

    Python 5

  3. fast-crewai fast-crewai Public

    Drop-in performance acceleration for CrewAI - Get up to 34x faster serialization, 17x faster tool execution, and 11x faster database search with zero code changes to your existing CrewAI projects.

    Python 1 1

  4. fast-axolotl fast-axolotl Public

    High-performance Rust extensions for Axolotl (no OOM for large datasets) - drop-in acceleration for existing installations.

    Python 1

  5. fastworker fastworker Public

    Add background workers to your FastAPI and Python applications in seconds, without the complexity.

    Python 2 1

  6. mullama mullama Public

    Mullama provides memory-safe Rust bindings for llama.cpp with production-ready features including async/await support, real-time streaming, multimodal processing, and web framework integration.

    Rust

Repositories

Showing 10 of 10 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…