Alternatives and similar repositories for bytepiece-rs

Users that are interested in bytepiece-rs are comparing it to the libraries listed below

• LaurentMazare / glim
  ☆20Updated 10 months ago
• chenwanqq / candle-llava
  implement llava using candle
  ☆15Updated last year
• Academic-Hammer / HammerLLM
  1.4B sLLM for Chinese and English - HammerLLM🔨
  ☆44Updated last year
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• nkypy / candle-rwkv
  RWKV models and examples powered by candle.
  ☆19Updated 5 months ago
• gnp / minbpe-rs
  Port of Andrej Karpathy's minbpe to Rust
  ☆25Updated last year
• HITsz-TMG / KaLM-Embedding
  Code for KaLM-Embedding models
  ☆89Updated last month
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆58Updated last year
• atoma-network / atoma-infer
  Fast serverless LLM inference, in Rust.
  ☆88Updated 5 months ago
• eugenehp / gpu-fft
  GPU based FFT written in Rust and CubeCL
  ☆23Updated 2 months ago
• Jacob-Zhou / simple-csc
  This repository provides an implementation of "A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Correction B…
  ☆73Updated last month
• cryscan / web-rwkv
  Implementation of the RWKV language model in pure WebGPU/Rust.
  ☆314Updated last month
• liyucheng09 / llm-compressive
  Longitudinal Evaluation of LLMs via Data Compression
  ☆32Updated last year
• llm-factory / imitater
  Imitate OpenAI with Local Models
  ☆88Updated 11 months ago
• vtuber-plan / langport
  Langport is a language model inference service
  ☆94Updated 11 months ago
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆191Updated last year
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆80Updated last year
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Updated last year
• jshuadvd / LongRoPE
  Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
  ☆148Updated last year
• OpenBMB / cpm_kernels
  ☆24Updated last year
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆64Updated last year
• HillZhang1999 / RobustGEC
  Code & Data for our Paper "RobustGEC: Robust Grammatical Error Correction Against Subtle Context Perturbation" (EMNLP 2023)
  ☆17Updated last year
• LowinLi / transformers-stream-generator
  This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/…
  ☆97Updated last year
• Oneflow-Inc / one-glm
  A more efficient GLM implementation!
  ☆55Updated 2 years ago
• beichao1314 / Open-Llama
  The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.
  ☆67Updated 2 years ago
• liuqi6777 / pe_rank
  Leveraging passage embeddings for efficient listwise reranking with large language models.
  ☆46Updated 8 months ago
• kyutai-labs / kaudio
  Rust crate for some audio utilities
  ☆26Updated 5 months ago
• serega / gaoya
  Locality Sensitive Hashing
  ☆72Updated 2 years ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆40Updated last year
• Dan-wanna-M / kbnf
  A high-performance constrained decoding engine based on context free grammar in Rust
  ☆54Updated 2 months ago