Alternatives and similar repositories for minbpe-pytorch

Users that are interested in minbpe-pytorch are comparing it to the libraries listed below

• LaurentMazare / mamba.rs
  ☆135Updated last year
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆155Updated 8 months ago
• mithril-security / tokenizers-wasm
  wasm bindings for huggingface tokenizers library
  ☆34Updated 3 years ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆70Updated 8 months ago
• beowolx / rensa
  High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…
  ☆225Updated last week
• Narsil / bloomserver
  ☆39Updated 3 years ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated 2 years ago
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆197Updated last year
• RAIVNLab / AdANNS
  Code repository for the paper - "AdANNS: A Framework for Adaptive Semantic Search"
  ☆66Updated 2 years ago
• abetlen / program-constrained-language-model-sampling
  ☆35Updated 2 years ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• charlesfrye / cuda-substrings
  Because it's there.
  ☆16Updated last year
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆39Updated 2 years ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆196Updated last year
• raphaelsty / neural-tree
  Tree-based indexes for neural-search
  ☆31Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• LAION-AI / AIW
  Alice in Wonderland code base for experiments and raw experiments data
  ☆131Updated 3 months ago
• Narsil / fast_gpt2
  ☆157Updated 2 years ago
• geov-ai / geov
  The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…
  ☆121Updated 2 years ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated 2 months ago
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆65Updated 2 years ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year
• fabiocannizzo / FastBinarySearch
  Fast and vectorizable algorithms for searching in a vector of sorted floating point numbers
  ☆153Updated last year
• bhosmer / mm
  ☆138Updated last year
• chenwanqq / candle-llava
  implement llava using candle
  ☆15Updated last year
• Cerebras / gigaGPT
  a small code base for training large models
  ☆318Updated 8 months ago
• Chillee / lit-llama
  Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code
  ☆10Updated 2 years ago
• cyrilou242 / ftcc
  Fast Text Classification with Compressors dictionary
  ☆150Updated 2 years ago
• dropbox / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆55Updated 4 months ago