Alternatives and similar repositories for nanoChatGPT:

Users that are interested in nanoChatGPT are comparing it to the libraries listed below

• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆145Updated last year
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆230Updated 5 months ago
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆56Updated 7 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆42Updated 10 months ago
• cindysridykhan / instruct_storyteller_tinyllama2
  Training and Fine-tuning an llm in Python and PyTorch.
  ☆41Updated last year
• rmihaylov / mpttune
  Tune MPTs
  ☆84Updated last year
• geronimi73 / phi2-finetune
  ☆87Updated last year
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆148Updated 7 months ago
• hydrallm / llama-moe-v1
  ☆94Updated last year
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆65Updated 5 months ago
• attentionmech / mav
  model activation visualiser
  ☆90Updated this week
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆71Updated last year
• mkurman / grpo-llm-evaluator
  Fine-tunes a student LLM using teacher feedback for improved reasoning and answer quality. Implements GRPO with teacher-provided evaluati…
  ☆39Updated 3 weeks ago
• swj0419 / detect-pretrain-code-contamination
  ☆74Updated last year
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆159Updated last year
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆77Updated 11 months ago
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆188Updated 9 months ago
• azharlabs / large-models
  ☆16Updated last year
• wangitu / Ada-Instruct
  ☆17Updated 11 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated last month
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆83Updated last month
• euclaise / supertrainer2000
  ☆49Updated last year
• cognitivecomputations / OpenChatML
  ☆152Updated 8 months ago
• leehanchung / lora-instruct
  Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA
  ☆102Updated 8 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆155Updated 5 months ago
• nyunAI / PruneGPT
  ☆53Updated 10 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆171Updated 10 months ago
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆99Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year