Alternatives and similar repositories for minbpe-pytorch

Users that are interested in minbpe-pytorch are comparing it to the libraries listed below

• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• catid / lllm
  Latent Large Language Models
  ☆18Updated 8 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆38Updated 2 months ago
• ahmed-moubtahij / TokenHealer
  ☆22Updated 11 months ago
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆84Updated 5 months ago
• stockeh / mlx-optimizers
  A collection of optimizers for MLX
  ☆35Updated this week
• CERC-AAI / Robin
  ☆63Updated 7 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• charlesfrye / cuda-substrings
  Because it's there.
  ☆16Updated 7 months ago
• cccntu / LoRAnanoGPT
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆18Updated 2 years ago
• xjdr-alt / muzero_sketch
  ☆38Updated 9 months ago
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆26Updated 7 months ago
• Chillee / lit-llama
  Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code
  ☆10Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆101Updated last year
• kddubey / cappr
  Completion After Prompt Probability. Make your LLM make a choice
  ☆76Updated 6 months ago
• mattneary / colorspace
  assign color hues to a collection of text fragments based on embeddings
  ☆20Updated 10 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆62Updated 11 months ago
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆59Updated 11 months ago
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 9 months ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• abetlen / program-constrained-language-model-sampling
  ☆35Updated 2 years ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated 2 years ago
• Zyphra / Zyda_processing
  ☆33Updated 10 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆78Updated 4 months ago