kuprel / minbpe-pytorch

Related projects ⓘ

Alternatives and complementary repositories for minbpe-pytorch

• catid / lllm
  Latent Large Language Models
  ☆16Updated 2 months ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆45Updated this week
• mikex86 / tritonc
  Standalone commandline CLI tool for compiling Triton kernels
  ☆15Updated 2 months ago
• jxmorris12 / gptzip
  Losslessly encode text natively with arithmetic coding and HuggingFace Transformers
  ☆71Updated 3 months ago
• UmerHA / triton_util
  Make triton easier
  ☆41Updated 5 months ago
• xjdr-alt / muzero_sketch
  ☆36Updated 3 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆51Updated 9 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆59Updated 5 months ago
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆63Updated 11 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 7 months ago
• abetlen / program-constrained-language-model-sampling
  ☆34Updated last year
• allenai / adapt-demos
  Lightweight tools for quick and easy LLM demo's
  ☆26Updated 2 months ago
• CERC-AAI / Robin
  ☆62Updated last month
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated last year
• charlesfrye / cuda-substrings
  Because it's there.
  ☆14Updated 2 months ago
• Narsil / bloomserver
  ☆36Updated 2 years ago
• Chillee / lit-llama
  Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code
  ☆10Updated last year
• LAION-AI / AIW
  Alice in Wonderland code base for experiments and raw experiments data
  ☆109Updated last month
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆47Updated 9 months ago
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆44Updated last year
• AI-Hypercomputer / maxdiffusion
  ☆156Updated last week
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆39Updated 3 months ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆44Updated 2 weeks ago
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆15Updated 3 weeks ago
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆43Updated 5 months ago
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆67Updated last year
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆21Updated 5 months ago
• NousResearch / StripedHyenaTrainer
  ☆57Updated 11 months ago