pierrel55 / llama_stLinks
Load and run Llama from safetensors files in C
☆14Updated last year
Alternatives and similar repositories for llama_st
Users that are interested in llama_st are comparing it to the libraries listed below
Sorting:
- 1.58-bit LLaMa model☆83Updated last year
- entropix style sampling + GUI☆27Updated last year
- Train your own small bitnet model☆76Updated last year
- LLM backed Fantasy Tribe Game☆19Updated last year
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆41Updated last year
- Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.☆150Updated 5 months ago
- SwiftLet is a lightweight Python framework for running open-source Large Language Models (LLMs) locally using safetensors☆28Updated 4 months ago
- Running Microsoft's BitNet via Electron, React & Astro☆48Updated 2 months ago
- Video+code lecture on building nanoGPT from scratch☆68Updated last year
- ☆62Updated 5 months ago
- ☆136Updated last year
- Yet another frontend for LLM, written using .NET and WinUI 3☆10Updated 3 months ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆47Updated last month
- Inference RWKV v7 in pure C.☆42Updated 2 months ago
- Tiny Llama model trained to play chess☆27Updated 5 months ago
- Experiments with BitNet inference on CPU☆54Updated last year
- Inference of Mamba models in pure C☆195Updated last year
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆23Updated last year
- ☆19Updated 3 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.☆19Updated 3 months ago
- JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.☆22Updated last year
- run ollama & gguf easily with a single command☆52Updated last year
- win32 native frontend for llama-cli☆12Updated last year
- Efficient non-uniform quantization with GPTQ for GGUF☆57Updated 3 months ago
- 5X faster 60% less memory QLoRA finetuning☆21Updated last year
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆103Updated 7 months ago
- ☆41Updated 4 months ago
- GPT-2 small trained on phi-like data☆67Updated last year
- High-Performance Text Deduplication Toolkit☆59Updated 3 months ago