SuriyaaMM / featherLinks
Lower Precision Floating Point Operations
☆66Updated last month
Alternatives and similar repositories for feather
Users that are interested in feather are comparing it to the libraries listed below
Sorting:
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input your VRAM and RAM and the toolcha…☆76Updated this week
- Sparse Inferencing for transformer based LLMs☆217Updated 6 months ago
- NVIDIA Linux open GPU with P2P support☆129Updated this week
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆49Updated 3 months ago
- ☆90Updated 2 months ago
- DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference☆603Updated 2 months ago
- LLM Inference on consumer devices☆129Updated 10 months ago
- ☆71Updated 7 months ago
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆156Updated this week
- ☆51Updated 2 months ago
- Generate a llama-quantize command to copy the quantization parameters of any GGUF☆30Updated 2 weeks ago
- RAM is all you need☆260Updated 2 months ago
- ☆163Updated 7 months ago
- Welcome to the official repository of SINQ! A novel, fast and high-quality quantization method designed to make any Large Language Model …☆590Updated 3 weeks ago
- REAP: Router-weighted Expert Activation Pruning for SMoE compression☆232Updated 2 months ago
- ik_llama.cpp's Thireus fork with release builds for macOS/Windows/Ubuntu CPU and Windows CUDA☆53Updated this week
- a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…☆51Updated last year
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆626Updated 2 weeks ago
- automatically quant GGUF models☆219Updated last month
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆82Updated this week
- Train your own small bitnet model☆77Updated last year
- My personal fork of koboldcpp where I hack in experimental samplers.☆44Updated last year
- ☆151Updated this week
- Make abliterated models with transformers, easy and fast☆116Updated 2 weeks ago
- ☆62Updated 7 months ago
- Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.☆157Updated 7 months ago
- ☆112Updated 7 months ago
- llama3.cuda is a pure C/CUDA implementation for Llama 3 model.☆350Updated 9 months ago
- Writing Extension for Text Generation WebUI☆64Updated 6 months ago
- High-performance FlashAttention-2 for AMD, Intel, and Apple GPUs. Drop-in replacement for PyTorch SDPA. Triton backend for ROCm (MI300X, …☆147Updated 2 weeks ago