Alternatives and similar repositories for llama_st

Users that are interested in llama_st are comparing it to the libraries listed below

• ideaweaver-ai / Tiny-Children-Stories-30M-model
  ☆122Updated 7 months ago
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆154Updated 6 months ago
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆49Updated 3 months ago
• introlix / Swiftlet
  SwiftLet is a lightweight Python framework for running open-source Large Language Models (LLMs) locally using safetensors
  ☆28Updated 5 months ago
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆53Updated 9 months ago
• lazy-guy / chess-llama
  Tiny Llama model trained to play chess
  ☆27Updated 5 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆76Updated last year
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆83Updated last year
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆106Updated 7 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆41Updated last year
• reka-ai / rekaquant
  ☆62Updated 6 months ago
• gigit0000 / qwen3.c
  Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.
  ☆21Updated 4 months ago
• ideaweaver-ai / DeepSeek-Children-Stories-15M-model
  ☆109Updated 6 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• nyunAI / PruneGPT
  ☆51Updated last year
• Antoine-Villiere / JacQues
  JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.
  ☆22Updated last week
• lorenzodimauro97 / FileCollector
  ☆18Updated 4 months ago
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆27Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆196Updated last year
• IST-DASLab / gptq-gguf-toolkit
  Efficient non-uniform quantization with GPTQ for GGUF
  ☆57Updated 4 months ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆55Updated last year
• smolorg / smoltropix
  MLX port for xjdr's entropix sampler (mimics jax implementation)
  ☆61Updated last year
• KevlarKanou / rwkv7.c
  Inference RWKV v7 in pure C.
  ☆43Updated 3 months ago
• conanhujinming / text_dedup
  High-Performance Text Deduplication Toolkit
  ☆61Updated 4 months ago
• h9-tec / Qwen_MOE_C
  ☆41Updated 5 months ago
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆47Updated 2 months ago
• fishiatee / Tumera
  Yet another frontend for LLM, written using .NET and WinUI 3
  ☆10Updated 4 months ago
• gowrav-vishwakarma / ai-video-generator-editor
  ☆19Updated 3 months ago
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆68Updated last year