Alternatives and similar repositories for build-nanogpt

Users that are interested in build-nanogpt are comparing it to the libraries listed below

• QuixiAI / grokadamw
  ☆136Updated last year
• teknium1 / ShareGPT-Builder
  ☆116Updated 10 months ago
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated last year
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆90Updated last year
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆107Updated 7 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆102Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆41Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆86Updated 6 months ago
• QuixiAI / kraken
  ☆67Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆177Updated last year
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆145Updated 8 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆62Updated 8 months ago
• ritabratamaiti / AnyModal
  AnyModal is a Flexible Multimodal Language Model Framework for PyTorch
  ☆103Updated 10 months ago
• NousResearch / Obsidian
  Maybe the new state of the art vision model? we'll see 🤷‍♂️
  ☆165Updated last year
• AlexBodner / How_Much_VRAM
  ☆102Updated last year
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆202Updated last year
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆92Updated 5 months ago
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆27Updated 11 months ago
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆94Updated 5 months ago
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆158Updated 5 months ago
• sshh12 / multi_token
  Embed arbitrary modalities (images, audio, documents, etc) into large language models.
  ☆186Updated last year
• joey00072 / Multi-Head-Latent-Attention-MLA-
  working implimention of deepseek MLA
  ☆44Updated 9 months ago
• Vaibhavs10 / optimise-my-whisper
  ☆207Updated last year
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆84Updated 2 months ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆106Updated last year
• bdambrosio / AllTheWorldAPlay
  All the world is a play, we are but actors in it.
  ☆50Updated 3 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated last month
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆221Updated last year
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆264Updated last year