Alternatives and similar repositories for llama_st

Users that are interested in llama_st are comparing it to the libraries listed below

• gowrav-vishwakarma / ai-video-generator-editor
  ☆16Updated this week
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆27Updated 10 months ago
• reka-ai / rekaquant
  ☆62Updated 2 months ago
• introlix / Swiftlet
  SwiftLet is a lightweight Python framework for running open-source Large Language Models (LLMs) locally using safetensors
  ☆28Updated last month
• Antoine-Villiere / JacQues
  JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.
  ☆22Updated last year
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆82Updated last year
• FishiaTee / Tumera
  Yet another frontend for LLM, written using .NET and WinUI 3
  ☆10Updated last week
• foundation-model-stack / fms-model-optimizer
  FMS Model Optimizer is a framework for developing reduced precision neural network models.
  ☆20Updated 3 weeks ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆41Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆69Updated last year
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆114Updated 2 months ago
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆44Updated 3 months ago
• QuixiAI / grokadamw
  ☆135Updated last year
• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆19Updated 10 months ago
• ideaweaver-ai / DeepSeek-Children-Stories-15M-model
  ☆99Updated 3 months ago
• nyunAI / PruneGPT
  ☆51Updated last year
• IST-DASLab / gptq-gguf-toolkit
  GPTQ and efficient search for GGUF
  ☆48Updated last week
• ideaweaver-ai / Tiny-Children-Stories-30M-model
  ☆115Updated 3 months ago
• huseinzol05 / transformers-continuous-batching
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆27Updated 6 months ago
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆93Updated 4 months ago
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 9 months ago
• axolotl-ai-cloud / axolotl-cookbook
  ☆34Updated last month
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• lazy-guy / chess-llama
  Tiny Llama model trained to play chess
  ☆26Updated 2 months ago
• Cornell-RelaxML / yaqa-quantization
  ☆57Updated 3 months ago
• Ce-daros / Tinystory-LM-656K-param
  ☆20Updated last year
• lorenzodimauro97 / FileCollector
  ☆17Updated last month
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated last year
• hasaranga / NativeChat
  win32 native frontend for llama-cli
  ☆12Updated 10 months ago
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆42Updated 2 weeks ago