Alternatives and similar repositories for minbpe-pytorch:

Users that are interested in minbpe-pytorch are comparing it to the libraries listed below

• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• abetlen / program-constrained-language-model-sampling
  ☆35Updated 2 years ago
• charlesfrye / cuda-substrings
  Because it's there.
  ☆16Updated 7 months ago
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆26Updated 7 months ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆20Updated last year
• euclaise / supertrainer2000
  ☆49Updated last year
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 8 months ago
• mattneary / colorspace
  assign color hues to a collection of text fragments based on embeddings
  ☆20Updated 10 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated last year
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 5 months ago
• catid / lllm
  Latent Large Language Models
  ☆17Updated 7 months ago
• Chillee / lit-llama
  Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code
  ☆10Updated last year
• Narsil / bloomserver
  ☆39Updated 2 years ago
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated last year
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated 3 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆53Updated last year
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 2 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 6 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆78Updated 9 months ago
• agemoai / arcsolver
  A Python library for automatically solving Abstraction and Reasoning Corpus (ARC) challenges using Claude and object-centric modeling.
  ☆21Updated 3 months ago
• UmerHA / triton_util
  Make triton easier
  ☆47Updated 10 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• character-ai / MuKoe
  ☆53Updated 11 months ago
• CERC-AAI / Robin
  ☆63Updated 6 months ago