bpe-0.2.1
- bpe 0.2.1
- Permalink
- Docs.rs crate page
- MIT
- Links
- Repository
- crates.io
- Source
- Owners
- hendrikvanantwerpen
- gorzell
- aneubeck
- Dependencies
- aneubeck-daachorse ^1.1.1 normal
  base64 ^0.22 normal optional
  fnv ^1.0 normal
  itertools ^0.14 normal
  rand ^0.9 normal optional
  serde ^1 normal
  tiktoken-rs ^0.6 dev
- Versions
- 63.04% of the crate is documented
Platform
Feature flags

docs.rs

Rust

Crate bpe

bpe0.2.1

All Items

Crate Items

Modules

Crate bpe

Modules§

appendable_encoder
backtrack_encoder
byte_pair_encoding
interval_encoding
prependable_encoder