Alternatives and similar repositories for llama_st

Users that are interested in llama_st are comparing it to the libraries listed below

• lazy-guy / chess-llama
  Tiny Llama model trained to play chess
  ☆27Updated 3 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆41Updated last year
• introlix / Swiftlet
  SwiftLet is a lightweight Python framework for running open-source Large Language Models (LLMs) locally using safetensors
  ☆28Updated 3 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆83Updated last year
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆27Updated last year
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆75Updated last year
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• huseinzol05 / transformers-continuous-batching
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆29Updated 7 months ago
• reka-ai / rekaquant
  ☆62Updated 3 months ago
• ideaweaver-ai / DeepSeek-Children-Stories-15M-model
  ☆105Updated 4 months ago
• FishiaTee / Tumera
  Yet another frontend for LLM, written using .NET and WinUI 3
  ☆10Updated last month
• QuixiAI / grokadamw
  ☆136Updated last year
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• nyunAI / PruneGPT
  ☆51Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆68Updated last year
• ideaweaver-ai / Tiny-Children-Stories-30M-model
  ☆118Updated 4 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆97Updated 5 months ago
• IST-DASLab / gptq-gguf-toolkit
  Efficient non-uniform quantization with GPTQ for GGUF
  ☆52Updated last month
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆46Updated last month
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆67Updated last year
• KevlarKanou / rwkv7.c
  Inference RWKV v7 in pure C.
  ☆41Updated 3 weeks ago
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆98Updated 11 months ago
• mgerstgrasser / tacheles
  a lightweight, open-source blueprint for building powerful and scalable LLM chat applications
  ☆28Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆44Updated last week
• gowrav-vishwakarma / ai-video-generator-editor
  ☆19Updated last month
• gigit0000 / qwen3.c
  Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.
  ☆17Updated 2 months ago
• foundation-model-stack / fms-model-optimizer
  FMS Model Optimizer is a framework for developing reduced precision neural network models.
  ☆20Updated last week
• charmandercha / ArchiDoc
  ☆17Updated 10 months ago