Alternatives and similar repositories for bytepiece-rs

Users that are interested in bytepiece-rs are comparing it to the libraries listed below

• nkypy / candle-rwkv
  RWKV models and examples powered by candle.
  ☆20Updated 9 months ago
• vtuber-plan / langport
  Langport is a language model inference service
  ☆95Updated last year
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• chenwanqq / candle-llava
  implement llava using candle
  ☆15Updated last year
• LaurentMazare / glim
  ☆19Updated last year
• HITsz-TMG / KaLM-Embedding
  Code for KaLM-Embedding models
  ☆104Updated 5 months ago
• Jacob-Zhou / simple-csc
  This repository provides an implementation of "A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Correction B…
  ☆85Updated 5 months ago
• serega / gaoya
  Locality Sensitive Hashing
  ☆77Updated 2 years ago
• huggingface / pyo3-special-method-derive
  Automatically derive Python dunder methods for your Rust code
  ☆20Updated 8 months ago
• cryscan / web-rwkv
  Implementation of the RWKV language model in pure WebGPU/Rust.
  ☆333Updated 2 months ago
• Oneflow-Inc / one-glm
  A more efficient GLM implementation!
  ☆54Updated 2 years ago
• Dan-wanna-M / kbnf
  A high-performance constrained decoding engine based on context free grammar in Rust
  ☆56Updated 7 months ago
• mrsteyk / RWKV-LM-deepspeed
  ☆44Updated 2 years ago
• LowinLi / transformers-stream-generator
  This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/…
  ☆97Updated last year
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆58Updated last year
• LC1332 / Luotuo-Silk-Road
  Silk Road will be the dataset zoo for Luotuo(骆驼). Luotuo is an open sourced Chinese-LLM project founded by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子…
  ☆40Updated 2 years ago
• alanshi / charset_mnbvc
  本项目旨在对大量文本文件进行快速编码检测和转换以辅助mnbvc语料集项目的数据清洗工作
  ☆67Updated 2 months ago
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆197Updated last year
• Academic-Hammer / HammerLLM
  1.4B sLLM for Chinese and English - HammerLLM🔨
  ☆43Updated last year
• haixuanTao / bert-onnx-rs-server
  A Demo server serving Bert through ONNX with GPU written in Rust with <3
  ☆42Updated 4 years ago
• jshuadvd / LongRoPE
  Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
  ☆152Updated last year
• liyucheng09 / llm-compressive
  Longitudinal Evaluation of LLMs via Data Compression
  ☆33Updated last year
• seanzhang-zhichen / baichuan-Dynamic-NTK-ALiBi
  百川Dynamic NTK-ALiBi的代码实现：无需微调即可推理更长文本
  ☆49Updated 2 years ago
• kyutai-labs / kaudio
  Rust crate for some audio utilities
  ☆25Updated 9 months ago
• the-seeds / imitater
  Imitate OpenAI with Local Models
  ☆89Updated last year
• AtomaAI / atoma-infer
  Fast serverless LLM inference, in Rust.
  ☆108Updated last month
• gnp / minbpe-rs
  Port of Andrej Karpathy's minbpe to Rust
  ☆30Updated last year
• EndlessReform / fish-speech.rs
  A Fish Speech implementation in Rust, with Candle.rs
  ☆106Updated 6 months ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆41Updated last year
• yinmingjun / TinyBERT
  ☆93Updated 6 years ago