Alternatives and similar repositories for minbpe-pytorch

Users that are interested in minbpe-pytorch are comparing it to the libraries listed below

• beowolx / rensa
  High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…
  ☆220Updated last week
• LaurentMazare / mamba.rs
  ☆135Updated last year
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆39Updated 2 years ago
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆151Updated 7 months ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆194Updated last year
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆65Updated 2 years ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• Const-me / Cgml
  GPU-targeted vendor-agnostic AI library for Windows, and Mistral model implementation.
  ☆57Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• fabiocannizzo / FastBinarySearch
  Fast and vectorizable algorithms for searching in a vector of sorted floating point numbers
  ☆153Updated 11 months ago
• abetlen / program-constrained-language-model-sampling
  ☆35Updated 2 years ago
• Narsil / fast_gpt2
  ☆157Updated 2 years ago
• cohere-ai / BinaryVectorDB
  Efficient vector database for hundred millions of embeddings.
  ☆211Updated last year
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆70Updated 7 months ago
• LaurentMazare / glim
  ☆19Updated last year
• oxidized-transformers / oxidized-transformers
  Modular Rust transformer/LLM library using Candle
  ☆37Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated 2 months ago
• bhosmer / mm
  ☆138Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆58Updated last year
• Cerebras / gigaGPT
  a small code base for training large models
  ☆315Updated 7 months ago
• valine / training-hot-swap
  Pytorch script hot swap: Change code without unloading your LLM from VRAM
  ☆125Updated 7 months ago
• Narsil / bloomserver
  ☆39Updated 3 years ago
• MinishLab / model2vec-rs
  Official Rust Implementation of Model2Vec
  ☆143Updated 2 months ago
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆196Updated last year
• raphaelsty / neural-tree
  Tree-based indexes for neural-search
  ☆31Updated last year
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• charlesfrye / cuda-substrings
  Because it's there.
  ☆16Updated last year
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆85Updated last year
• yaman / fashion-clip-rs
  A complete(grpc service and lib) Rust inference with multilingual embedding support. This version leverages the power of Rust for both GR…
  ☆39Updated last year