EOQ: Entropy-Optimal Quantization for LLMs. 11-41% smaller than GGUF Q4_K_M with near-FP16 perplexity.
☆46Mar 31, 2026Updated 4 months ago
Alternatives and similar repositories for eoq-quantization
Users that are interested in eoq-quantization are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Orquestr Pro - AI Assistant Desktop App☆17Mar 5, 2026Updated 4 months ago
- Hermes Agent plugin: transparent per-token cost accounting for local LLM inference rigs☆22Updated this week
- Reverse engineering toolkit for Apple Silicon private APIs. 55+ Apple Intelligence models mapped, Metal 4 ML pipeline, 1009 IOReport chan…☆15Mar 26, 2026Updated 4 months ago
- 30 tok/s for 20B MoE on 8 GB VRAM. Flat throughput to 32K context. Native MXFP4 + GGUF Q4_K/Q5_K/Q6_K via ggml CUDA kernels — zero dequan…☆19Apr 7, 2026Updated 3 months ago
- llama.cpp fork with TQ3_1S/4S CUDA kernels — 3.5-bit WHT quantization achieving Q4s quality at 10% smaller size. Based on RaBitQ-inspired…☆222Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [ICLR 2026] ParoQuant: Pairwise Rotation Quantization for Efficient Reasoning LLM Inference☆326Jul 1, 2026Updated last month
- Fast Client-side PDF Dark Mode Converter - Instantly apply dark mode to PDFs in your browser, Preserve images, keep text searchable and s…☆31Jul 13, 2026Updated 3 weeks ago
- AI-assisted software development methodology for solo builders☆21Updated this week
- Automatically externalize dependencies and peerDependencies in a bundle.☆11May 9, 2026Updated 2 months ago
- File system based wiki, maintained by Claude☆64Apr 8, 2026Updated 3 months ago
- [TMM 2025] Official Implementation of DreamJourney: Perpetual View Generation with Video Diffusion Models☆18Jun 24, 2025Updated last year
- The ultimate training toolkit for finetuning diffusion models☆17Jul 7, 2025Updated last year
- [ICLR 2026] Official code for BézierFlow: Learning Bézier Stochastic Interpolant Schedulers for Few-Step Generation☆23Apr 13, 2026Updated 3 months ago
- A lightweight analytics platform built on Upstash Redis, providing event tracking, session management, feature flags, and A/B testing wit…☆17May 25, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- OpenClaw Operator gives coding agents like Codex and Claude Code the context and playbooks needed to set up, validate, and troubleshoot a…☆20Mar 7, 2026Updated 4 months ago
- Self-hosted AI-powered personal knowledge base. Save content from 17+ platforms, auto-tag, summarize, and connect with semantic search.☆62Updated this week
- Towards Robust Fact-Checking: A Multi-Agent System with Advanced Evidence Retrieval☆15Jun 24, 2025Updated last year
- The predecessor of CiteLab.☆18Feb 3, 2026Updated 6 months ago
- AGI runtime for bounded recursive self-awareness. Attempting machine consciousness at the Gödel–Turing–Hofstadter Nexus.☆17Mar 24, 2026Updated 4 months ago
- A NodeJS application to upload, watch and stream live videos.☆12Jan 24, 2023Updated 3 years ago
- Specialized fork for (relatively) fast single-GPU inference (in CUDA) using large MoE models that don't fit fully into VRAM☆17May 6, 2026Updated 2 months ago
- MCP server for Semantic Scholar to search for papers☆20Apr 5, 2025Updated last year
- Rust FTL + WebRTC live streaming software.☆13Mar 12, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A ComfyUI and ComfyScript Gradio-based app for generating characters using a multi-step process.☆20Nov 5, 2025Updated 8 months ago
- The original BabyAGI, updated with LiteLLM and no vector database reliance (csv instead)☆22Oct 2, 2024Updated last year
- ☆16Jul 4, 2025Updated last year
- ☆20Feb 2, 2025Updated last year
- Permission React Role is a comprehensive and lightweight solution for managing access control and user permissions in React applications.…☆17Sep 30, 2024Updated last year
- Neural Memory Compression System for RAG Applications☆20Nov 20, 2025Updated 8 months ago
- LINQ for JavaScript library, which allows to work with arrays in a more easy way and focus on business logic.☆11Dec 19, 2016Updated 9 years ago
- ☆23Feb 27, 2025Updated last year
- experimental electron app for real-time speech translation with AI☆16Nov 16, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- We want to create a dashboard (with knowledge graphs) to visualize the network node communication situation based on the firewall logs to…☆16Oct 26, 2024Updated last year
- MCP server that gives AI agents the ability to execute cross-chain cryptocurrency swaps and transfers via the deBridge protocol☆32Apr 1, 2026Updated 4 months ago
- ☆33Updated this week
- The official implementation of "Rectified SpaAttn: Revisiting Attention Sparsity for Efficient Video Generation"☆22Feb 8, 2026Updated 5 months ago
- A2A MCP Server is a lightweight Python bridge that lets Claude Desktop or any MCP client talk to A2A agents. It provides three tools: reg…☆21May 4, 2025Updated last year
- Configuration framework for Google Antigravity IDE with structured workflows and MCP integrations☆28Feb 2, 2026Updated 6 months ago
- Image-Free Timestep Distillation via Continuous-Time Consistency with Trajectory-Sampled Pairs☆21Dec 16, 2025Updated 7 months ago