TurboQuant KV cache compression plugin for vLLM — asymmetric K/V, 8 models validated, consumer GPUs
☆48Apr 10, 2026Updated 3 months ago
Alternatives and similar repositories for turboquant-vllm
Users that are interested in turboquant-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM TurboQuant☆610Jun 25, 2026Updated 3 weeks ago
- Reward Evolution with Large Language Models using Human Feedback☆20Nov 14, 2025Updated 8 months ago
- A simple GPT-3 interface to automate core legal writing tasks☆13Mar 8, 2023Updated 3 years ago
- Browse Lance tables from your local machine in a simple web UI. No database to set up. Mount a folder and go.☆49Jun 11, 2026Updated last month
- Developing a legal research tool leveraging ChatGPT / GPT-4☆14Mar 10, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 基于langchain和chatglm6b构建的智能问答系统，支持自定义语料☆10Jun 25, 2023Updated 3 years ago
- Probe how GPT-n performs on statutory reasoning☆10Sep 17, 2024Updated last year
- A question answering AI tool for the content from the PDF files of the Civil Code, Criminal Code, Code of Criminal Procedure, Labor Stand…☆12May 14, 2023Updated 3 years ago
- AI-assisted software development methodology for solo builders☆21Updated this week
- 本项目主要研究大模型在单独的法律数据集上的效果，现在支持belle和chatglm相关的模型训练，预测，验证和在线部署， 另外增加爬虫代码，langchain，结合数据库预测等功能。☆12Jul 16, 2023Updated 3 years ago
- 爬取去哪网热门景点信息，抽取三元组信息，构建中文知识图谱☆13Apr 27, 2021Updated 5 years ago
- ☆11Nov 13, 2020Updated 5 years ago
- Learning Accurate Decision Trees with Bandit Feedback via Quantized Gradient Descent☆16Sep 8, 2022Updated 3 years ago
- Experiments codes for COLING '22 paper "Augmenting Legal Judgment Prediction with Contrastive Case Relations"☆11Apr 25, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Graph QABot Demo| 图谱问答案例☆14Apr 11, 2023Updated 3 years ago
- An interactive course on prompt engineering for lawyers built using streamlit.☆19Sep 1, 2024Updated last year
- ☆11Dec 8, 2022Updated 3 years ago
- [ICML 2025] Adaptive Self-improvement LLM Agentic System for ML Library Development☆17Jan 6, 2026Updated 6 months ago
- KimiaPath24: Dataset for retrieval and classification in digital pathology☆13Jun 4, 2017Updated 9 years ago
- Optimizing Deep Convolutional Neural Network with Ternarized Weights and High Accuracy☆16Jan 27, 2019Updated 7 years ago
- ☆52May 20, 2025Updated last year
- Mixed-precision quantization for LLMs. Every layer refracts into a different format based on its sensitivity. Native compressed-tensors e…☆93Updated this week
- 中国法研杯 CAIL 2019☆13Jun 17, 2019Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- This repository is about an APP to help lawyers to process law documents and suit cases using AI Agents trained with OpenAI and others LL…☆18Aug 14, 2023Updated 2 years ago
- 基于ASP.NET的图书租赁管理系统 ，运行操作请查看ReadMe.txt文件☆11Apr 20, 2016Updated 10 years ago
- Unit Scaling demo and experimentation code☆16Mar 12, 2024Updated 2 years ago
- Explore a smarter way to shop online with this full-stack project built on the infrastructure of Google Cloud Platform (GCP) for RAG base…☆16Sep 26, 2025Updated 9 months ago
- This Repositry is an experiment with an agent that searches documents and asks questions repeatedly in response to the main question. It …☆19Jul 17, 2023Updated 3 years ago
- Home-enthusiast's guide to fine-tuning 27B+ LLMs on AMD Strix Halo (gfx1151, Ryzen AI MAX+ 395) — the patches and tuning to make Linux ma…☆26Jun 9, 2026Updated last month
- Classifying Relations by Ranking with Convolutional Neural Networks☆12May 22, 2019Updated 7 years ago
- 医疗系统知识图谱问答☆12Feb 3, 2022Updated 4 years ago
- ☆16Apr 4, 2018Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This repository provides code source used in the paper: A Mean Field Theory of Quantized Deep Networks: The Quantization-Depth Trade-Off☆13May 30, 2019Updated 7 years ago
- Using SeqJudge to solve Legal Judgment Prediction.☆16Aug 24, 2018Updated 7 years ago
- This repository accompanies our research paper titled "An LLM-based Recommender System Environment".☆17Jul 15, 2024Updated 2 years ago
- Code for paper 'Minimizing FLOPs to Learn Efficient Sparse Representations' published at ICLR 2020☆20Feb 14, 2020Updated 6 years ago
- 一份中文法律文书生成对话应用。☆14Aug 24, 2023Updated 2 years ago
- 使用Tensorflow实现了一个简易的中文聊天机器人☆14Aug 16, 2018Updated 7 years ago
- Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".☆60May 11, 2019Updated 7 years ago