iuliaturc / gguf-docsLinks
Docs for GGUF quantization (unofficial)
☆73Updated this week
Alternatives and similar repositories for gguf-docs
Users that are interested in gguf-docs are comparing it to the libraries listed below
Sorting:
- A little(lil) Language Model (LM). A tiny reproduction of LLaMA 3's model architecture.☆53Updated 2 months ago
- ☆80Updated 4 months ago
- InferX is a Inference Function as a Service Platform☆116Updated 2 weeks ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆31Updated 3 months ago
- A random walk voice style cloning application for Kokoro text to speech☆103Updated last month
- AI management tool☆118Updated 8 months ago
- ☆85Updated 3 weeks ago
- ☆95Updated 6 months ago
- Streaming and Fine-tuning for Chatterbox TTS☆134Updated last month
- Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.☆89Updated last week
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆436Updated this week
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆67Updated 2 weeks ago
- Fast Streaming TTS with Orpheus + WebRTC (with FastRTC)☆299Updated 3 months ago
- A Conversational Speech Generation Model with Gradio UI and OpenAI compatible API. UI and API support CUDA, MLX and CPU devices.☆192Updated 2 months ago
- ☆204Updated last month
- Sparse Inferencing for transformer based LLMs☆193Updated this week
- ☆55Updated 9 months ago
- ☆80Updated this week
- ☆308Updated 3 months ago
- Testing LLM reasoning abilities with family relationship quizzes.☆62Updated 5 months ago
- ☆214Updated last month
- Dia-JAX: A JAX port of Dia, the text-to-speech model for generating realistic dialogue from text with emotion and tone control.☆27Updated 2 months ago
- ☆107Updated 2 months ago
- ☆49Updated 4 months ago
- A collection of prompts to challenge the reasoning abilities of large language models in presence of misguiding information☆430Updated 3 weeks ago
- Blue-text Bot AI. Uses Ollama + AppleScript☆50Updated last year
- ☆130Updated 2 months ago
- ☆146Updated last week
- Orpheus Chat WebUI☆68Updated 3 months ago
- The Fastest Way to Fine-Tune LLMs Locally☆312Updated 3 months ago