Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Dec 9, 2023

• Fix working, added deepseek template

  ricardo-st

  committed
  15a1967

  Copy full SHA for 15a1967

• Fixed basic_handler, so that it at least 'works', and currently testing handler with limitations

  ricardo-st

  committed
  fb9f202

  Copy full SHA for fb9f202

Commits on Dec 6, 2023

• Fix errors

  ricardo-st

  committed
  2b8120f

  Copy full SHA for 2b8120f

• Delete run_multiple.sh

  ricardo-st

  authored
  93bc9be

  Copy full SHA for 93bc9be

Commits on Nov 15, 2023

• Update README.md

  alpayariyak

  authored
  24feadd

  Copy full SHA for 24feadd

• vllm 0.2.1.post1 - speed boost, quantization, mistral support

  

  willsamu

  authored and

  alpayariyak

  committed
  4f79206

  Copy full SHA for 4f79206

Commits on Sep 21, 2023

• using vllm 0.1.7

  Jorghi12

  committed
  5bccd40

  Copy full SHA for 5bccd40

Commits on Sep 6, 2023

• fix aggre

  Jorghi12

  committed
  ba4e6e6

  Copy full SHA for ba4e6e6

• update

  Jorghi12

  committed
  871196d

  Copy full SHA for 871196d

Commits on Sep 1, 2023

• print out llm metrics, make metrics more verbose

  Jorghi12

  committed
  5e04e5e

  Copy full SHA for 5e04e5e

Commits on Aug 31, 2023

• take advantage of layering

  Jorghi12

  committed
  0618381

  Copy full SHA for 0618381

• upate metrics

  Jorghi12

  committed
  54d229c

  Copy full SHA for 54d229c

• update

  Jorghi12

  committed
  84d6047

  Copy full SHA for 84d6047

• metrics now included

  Jorghi12

  committed
  96c4d70

  Copy full SHA for 96c4d70

• update response

  Jorghi12

  committed
  c566266

  Copy full SHA for c566266

• finished

  Jorghi12

  committed
  9f1dd5a

  Copy full SHA for 9f1dd5a

• fix bug

  Jorghi12

  committed
  9eb099d

  Copy full SHA for 9eb099d

• update the handler

  Jorghi12

  committed
  460f3dd

  Copy full SHA for 460f3dd

Commits on Aug 30, 2023

• test

  Jorghi12

  committed
  50689a2

  Copy full SHA for 50689a2

• reduce logs

  Jorghi12

  committed
  e73e108

  Copy full SHA for e73e108

• finalize

  Jorghi12

  committed
  be4421e

  Copy full SHA for be4421e

• finalize

  Jorghi12

  committed
  66056e6

  Copy full SHA for 66056e6

• complete

  Jorghi12

  committed
  5e4865e

  Copy full SHA for 5e4865e

• fix metrics

  Jorghi12

  committed
  476498b

  Copy full SHA for 476498b

• win

  Jorghi12

  committed
  5fd4583

  Copy full SHA for 5fd4583

• update handler

  Jorghi12

  committed
  5b112b3

  Copy full SHA for 5b112b3

• fix

  Jorghi12

  committed
  244ce53

  Copy full SHA for 244ce53

Commits on Aug 29, 2023

• fix

  Jorghi12

  committed
  f79c834

  Copy full SHA for f79c834

• fix

  Jorghi12

  committed
  73c55b8

  Copy full SHA for 73c55b8

• update vllm version

  Jorghi12

  committed
  62961ce

  Copy full SHA for 62961ce

• improving metrics in worker

  Jorghi12

  committed
  acb120b

  Copy full SHA for acb120b

Commits on Aug 25, 2023

• done

  Jorghi12

  committed
  51d231c

  Copy full SHA for 51d231c

• update

  Jorghi12

  committed
  e3cdd46

  Copy full SHA for e3cdd46

Commits on Aug 24, 2023

• update

  Jorghi12

  committed
  d6cce5d

  Copy full SHA for d6cce5d

• update

  Jorghi12

  committed
  33ab560

  Copy full SHA for 33ab560

Pagination

Previous

Next