TurboQuant KV cache compression plugin for vLLM — asymmetric K/V, 8 models validated, consumer GPUs
☆50Apr 10, 2026Updated 5 months ago
Alternatives and similar repositories for turboquant-vllm
Users that are interested in turboquant-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM TurboQuant☆618Jun 25, 2026Updated 2 months ago
- A simple GPT-3 interface to automate core legal writing tasks☆13Mar 8, 2023Updated 3 years ago
- Vector search with Pinecone and Openai to search through contract law textbook. If downloaded, remeber to install all dependencies. Refer…☆11Mar 30, 2023Updated 3 years ago
- Chat bot for Sharesight, Yahoo Finance, Discord, Slack, and Telegram☆12Aug 31, 2026Updated 3 weeks ago
- ☆11Aug 1, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- function for agents in OpenWebUI☆17Jun 15, 2025Updated last year
- 基于langchain和chatglm6b构建的智能问答系统，支持自定义语料☆10Jun 25, 2023Updated 3 years ago
- Probe how GPT-n performs on statutory reasoning☆10Sep 17, 2024Updated 2 years ago
- PyTorch code for full quantization of DNN using BCGD☆14Jul 24, 2019Updated 7 years ago
- AI-assisted software development methodology for solo builders☆30Updated this week
- ☆18Mar 31, 2026Updated 5 months ago
- AI医生☆10May 27, 2020Updated 6 years ago
- A MCP (Model Context Protocol) server to allow code security reviews using https://osv.dev (Open Source Vulnerabilities Database)☆15Dec 24, 2025Updated 8 months ago
- 本项目主要研究大模型在单独的法律数据集上的效果，现在支持belle和chatglm相关的模型训练，预测，验证和在线部署， 另外增加爬虫代码，langchain，结合数据库预测等功能。☆12Jul 16, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An Tensorflow.keras implementation of Same, Same But Different - Recovering Neural Network Quantization Error Through Weight Factorizatio…☆10Dec 18, 2019Updated 6 years ago
- A OpenAI GPT3 based QnA agent for documents and links☆12Jul 11, 2023Updated 3 years ago
- Documenting best practices for implementing a read aloud feature in reading apps☆14Jun 2, 2025Updated last year
- Chatbot_CN项目的知识图谱模块☆12Mar 27, 2020Updated 6 years ago
- Graph QABot Demo| 图谱问答案例☆14Apr 11, 2023Updated 3 years ago
- ☆13Oct 10, 2024Updated last year
- Pure Rust OCR pipeline that re-implements the PaddleOCR (DBNet + SVTR\_HGNet) models without relying on C/C++ runtimes.☆18Nov 22, 2025Updated 10 months ago
- An integration of Qdrant ANN vector database backend with txtai☆25Jun 23, 2026Updated 2 months ago
- Efficient GPU kernels for mixed-precision Vision Transformers in Triton☆17Sep 18, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Mixed-precision quantization for LLMs. Every layer refracts into a different format based on its sensitivity. Native compressed-tensors e…☆103Updated this week
- Think of this PS-module as a helper for Microsoft Graph version-management, connectivity and data management using Microsoft Graph.☆15Apr 28, 2025Updated last year
- Explore a smarter way to shop online with this full-stack project built on the infrastructure of Google Cloud Platform (GCP) for RAG base…☆17Sep 26, 2025Updated 11 months ago
- This Repositry is an experiment with an agent that searches documents and asks questions repeatedly in response to the main question. It …☆19Jul 17, 2023Updated 3 years ago
- Unit Scaling demo and experimentation code☆15Mar 12, 2024Updated 2 years ago
- 构建一个医疗领域知识图谱和一个基于Flask的简易网页聊天机器人，通过ner获取用户问题的实体并在知识图谱内提取答案。☆11Apr 25, 2023Updated 3 years ago
- Classifying Relations by Ranking with Convolutional Neural Networks☆12May 22, 2019Updated 7 years ago
- My investigation of Voxtral Mini-3B's capabilities.☆15Jul 17, 2025Updated last year
- 医疗系统知识图谱问答☆12Feb 3, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Extension components for ChatGPT Apps SDK - Maps, Albums, Carousels and more. Built on @openai/apps-sdk-ui.☆15Dec 30, 2025Updated 8 months ago
- Python tool for exploiting CVE-2021-35616☆11Dec 3, 2021Updated 4 years ago
- ☆10Aug 10, 2015Updated 11 years ago
- Legal Juegment Prediction (LJP) with BiLSTM and Attention☆13Jan 10, 2019Updated 7 years ago
- [ICML 2021] "Double-Win Quant: Aggressively Winning Robustness of Quantized DeepNeural Networks via Random Precision Training and Inferen…☆16Feb 13, 2022Updated 4 years ago
- 基于文本相似度的win10智能客服问答系统☆16Mar 12, 2020Updated 6 years ago
- Using SeqJudge to solve Legal Judgment Prediction.☆16Aug 24, 2018Updated 8 years ago