Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Oct 29, 2025

• Make handler async and return early error messages instead of yielding (fix streaming)

  

  Vincent

  committed
  ad1c173

  Copy full SHA for ad1c173

Commits on Oct 22, 2025

• try to fix streaming

  

  Vincent

  committed
  6232c70

  Copy full SHA for 6232c70

• Restore Llama context size to 16384 (remove *4 multiplier)

  

  Vincent

  committed
  01e32b4

  Copy full SHA for 01e32b4

• Add clean_stream parser for channel-marked streaming output and use it in handler; increase Llama context (n_ctx=16384*4), disable verbose logging, add re import, and remove sleep/seconds handling

  

  Vincent

  committed
  e65e166

  Copy full SHA for e65e166

Commits on Oct 17, 2025

• first real attempt at getting the llm stuff working

  

  Vincent

  committed
  2a6750c

  Copy full SHA for 2a6750c

• Hoping to get cuda working

  

  Vincent

  committed
  f3a9bb0

  Copy full SHA for f3a9bb0

Commits on Oct 15, 2025

• change base

  

  Vincent

  committed
  1101e29

  Copy full SHA for 1101e29

• Fix handler return statement (remove stray '+')

  

  Vincent

  committed
  dcbf59f

  Copy full SHA for dcbf59f

• Auto-detect .gguf model on /runpod-volume and initialize Llama; add startup checks in handler, and install llama-cpp-python in Dockerfile

  

  Vincent

  committed
  0f91b23

  Copy full SHA for 0f91b23

• First test commit

  

  Vincent

  committed
  0471d6c

  Copy full SHA for 0471d6c

Commits on Jul 3, 2025

• Update requirements.txt

  Yhlong00

  authored
  e6c0944

  Copy full SHA for e6c0944

Commits on Mar 27, 2025

• Update rp_handler.py

  Yhlong00

  authored
  4de9ab5

  Copy full SHA for 4de9ab5

• Update rp_handler.py

  Yhlong00

  authored
  8b9b2be

  Copy full SHA for 8b9b2be

Commits on Mar 17, 2025

• fix: typo

  Yhlong00

  committed
  4083eed

  Copy full SHA for 4083eed

• first commit

  Yhlong00

  committed
  618bb2d

  Copy full SHA for 618bb2d