Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Jul 10, 2023

• Bump on version.

  TimDettmers

  committed
  b8da4a1

  Copy full SHA for b8da4a1

• Removed debugging statement.

  TimDettmers

  committed
  a26a321

  Copy full SHA for a26a321

• Fixed accidential deletion of limits in kernel.

  TimDettmers

  committed
  306f6b2

  Copy full SHA for 306f6b2

• Fixed potential memory leak.

  TimDettmers

  committed
  2221f4c

  Copy full SHA for 2221f4c

• Added generation tests.

  TimDettmers

  committed
  490153b

  Copy full SHA for 490153b

• Added ARCH guard for bfloat16 computations.

  TimDettmers

  committed
  1c774ec

  Copy full SHA for 1c774ec

• Fixed typo in cuda_install.sh.

  TimDettmers

  committed
  0a1cced

  Copy full SHA for 0a1cced

• Changelog and version bump.

  TimDettmers

  committed
  0d344b7

  Copy full SHA for 0d344b7

• Fixed Makefile and added CUDA 12.2 install.

  TimDettmers

  committed
  73aa4e0

  Copy full SHA for 73aa4e0

• Merge remote-tracking branch 'origin/inference'

  TimDettmers

  committed
  5f492d4

  Copy full SHA for 5f492d4

• Merge pull request #469 from shadeMe/linear-layer-device

  Show description for 196d6f5
  TimDettmers

  authored
  196d6f5

  Copy full SHA for 196d6f5

• Added fp32 compute type for gemv_4bit.

  TimDettmers

  committed
  5fab673

  Copy full SHA for 5fab673

• Added test for Param4bit.to() and fixed double quant behavior.

  TimDettmers

  committed
  cef519c

  Copy full SHA for cef519c

Commits on Jul 9, 2023

• Fixed a bug where gemv_4bit would return a wrongly sized tensor.

  TimDettmers

  committed
  6a905be

  Copy full SHA for 6a905be

• Added double quantization support and tests.

  TimDettmers

  committed
  0f0390a

  Copy full SHA for 0f0390a

• Added FP4 fast inference support.

  TimDettmers

  committed
  94168d7

  Copy full SHA for 94168d7

• Added abitrary data types; fixed a bug for small matrices.

  TimDettmers

  committed
  4b88d69

  Copy full SHA for 4b88d69

Commits on Jul 8, 2023

• Turning optimization (float accumulation). 185 vs 50.

  TimDettmers

  committed
  eefbf60

  Copy full SHA for eefbf60

• Added warp_shuffle indexing 185 vs 54.

  TimDettmers

  committed
  7e49b5b

  Copy full SHA for 7e49b5b

Commits on Jul 5, 2023

• Added bfloat16 quantizations and tests.

  TimDettmers

  committed
  02fd80c

  Copy full SHA for 02fd80c

Commits on Jul 4, 2023

• Vectorized loads, conflict free NF4; 52 vs 172.

  TimDettmers

  committed
  dfe6900

  Copy full SHA for dfe6900

• Initial 4-bit naive batch size 1, 81 vs 185.

  TimDettmers

  committed
  f89ff93

  Copy full SHA for f89ff93

Commits on Jun 20, 2023

• Release 0.39.1.

  TimDettmers

  committed
  4395d68

  Copy full SHA for 4395d68

Commits on Jun 19, 2023

• Merge pull request #503 from TimDettmers/efficient_8bit_serialize

  Show description for 2d321a7
  TimDettmers

  authored
  2d321a7

  Copy full SHA for 2d321a7

Commits on Jun 14, 2023

• Only rearrange weight if it exists

  mryab

  committed
  b599fdb

  Copy full SHA for b599fdb

Commits on Jun 9, 2023

• Rearrange the weights directly in state dict before loading

  mryab

  committed
  c1f3f56

  Copy full SHA for c1f3f56

• Improve memory efficiency of 8-bit serialization

  mryab

  committed
  f734076

  Copy full SHA for f734076

• Extract get_tile_inds to a separate function

  mryab

  committed
  4fb37d4

  Copy full SHA for 4fb37d4

Commits on Jun 1, 2023

• Add `device` parameter to `Embedding`

  shadeMe

  committed
  db49ad4

  Copy full SHA for db49ad4

• Add `device` parameter to `Linear` subclasses

  shadeMe

  committed
  9cac5dd

  Copy full SHA for 9cac5dd

Commits on May 31, 2023

• Added debugging functions.

  TimDettmers

  committed
  e54d273

  Copy full SHA for e54d273

• Added lookup table.

  TimDettmers

  committed
  b7f04e2

  Copy full SHA for b7f04e2

• Added changes for deployment.

  TimDettmers

  committed
  ac5550a

  Copy full SHA for ac5550a

Commits on May 24, 2023

• Bumped version.

  TimDettmers

  committed
  0f40fa3

  Copy full SHA for 0f40fa3

• Added PagedLion and bf16 Lion.

  TimDettmers

  committed
  1b8772a

  Copy full SHA for 1b8772a