Alternatives and similar repositories for minbpe-pytorch

Users that are interested in minbpe-pytorch are comparing it to the libraries listed below

• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆38Updated last year
• huggingface / ember
  ANE accelerated embedding models!
  ☆17Updated 5 months ago
• abetlen / program-constrained-language-model-sampling
  ☆35Updated 2 years ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆55Updated last year
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆62Updated 3 weeks ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆27Updated 8 months ago
• ryao / llama3.c
  A fork of llama3.c used to do some R&D on inferencing
  ☆22Updated 5 months ago
• catid / lllm
  Latent Large Language Models
  ☆18Updated 9 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 10 months ago
• Systemcluster / kitoken
  Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…
  ☆25Updated 2 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆21Updated 4 months ago
• Oxen-AI / GRPO-With-Cargo-Feedback
  This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback
  ☆94Updated 2 months ago
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆44Updated this week
• xjdr-alt / muzero_sketch
  ☆38Updated 10 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• AlpinDale / LLM-Shearing
  Preprint: Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆28Updated last year
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• beowolx / rensa
  High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…
  ☆147Updated this week
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆100Updated last year
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated 2 years ago
• spirobel / bunny-llama
  iterate quickly with llama.cpp hot reloading. use the llama.cpp bindings with bun.sh
  ☆47Updated last year
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated last year
• character-ai / MuKoe
  ☆54Updated last year
• Zyphra / Zyda_processing
  ☆34Updated 11 months ago
• UmerHA / triton_util
  Make triton easier
  ☆47Updated 11 months ago
• mikex86 / tritonc
  Standalone commandline CLI tool for compiling Triton kernels
  ☆18Updated 8 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 7 months ago