Alternatives and similar repositories for minbpe-pytorch:

Users that are interested in minbpe-pytorch are comparing it to the libraries listed below

• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 11 months ago
• huggingface / ember
  ANE accelerated embedding models!
  ☆17Updated 2 months ago
• NolanoOrg / SpectraSuite
  ☆44Updated 7 months ago
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆18Updated 4 months ago
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year
• Narsil / bloomserver
  ☆37Updated 2 years ago
• ajtejankar / mixtral-vis-moe
  Visualize expert firing frequencies across sentences in the Mixtral MoE model
  ☆17Updated last year
• ryao / llama3.c
  A fork of llama3.c used to do some R&D on inferencing
  ☆19Updated 2 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆54Updated last year
• charlesfrye / cuda-substrings
  Because it's there.
  ☆15Updated 5 months ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• mikex86 / tritonc
  Standalone commandline CLI tool for compiling Triton kernels
  ☆17Updated 5 months ago
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆37Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆79Updated 3 months ago
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• nisten / grokadamw
  new optimizer
  ☆19Updated 6 months ago
• abetlen / program-constrained-language-model-sampling
  ☆34Updated last year
• euclaise / supertrainer2000
  ☆49Updated 11 months ago
• ahmed-moubtahij / TokenHealer
  ☆22Updated 8 months ago
• UmerHA / triton_util
  Make triton easier
  ☆45Updated 8 months ago
• character-ai / MuKoe
  ☆52Updated 10 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated last month
• sekstini / basedxl
  ☆16Updated 11 months ago
• xjdr-alt / muzero_sketch
  ☆38Updated 7 months ago
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 6 months ago
• jkallini / mrt5
  Code repository for the paper "MrT5: Dynamic Token Merging for Efficient Byte-level Language Models."
  ☆34Updated 2 weeks ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated 11 months ago
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 4 months ago
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆26Updated 5 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆117Updated 3 months ago