Support mixed-precsion inference with vllm
☆84Jul 17, 2025Updated 8 months ago
Alternatives and similar repositories for vllm-mixed-precision
Users that are interested in vllm-mixed-precision are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official Implementation of AttentionShift: Iteratively Estimated Part-based Attention Map for Pointly Supervised Instance Segmentation☆155Oct 18, 2024Updated last year
- Welcome to the 'Open-Alteryx-Macro' project. This project is aimed at providing an open-source solution for managing and updating Alteryx…☆156May 25, 2024Updated last year
- Mixed precision inference by Tensorrt-LLM☆79Oct 23, 2024Updated last year
- kight is a static analysis tool for c/c++ programs.☆213Dec 27, 2024Updated last year
- Analysis and visualization of multi-omics data. In ongoing development: multi-modal fusion, sparse learning, and spatio-temporal effects.…☆205Jan 15, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- An Workspace for HMI tools☆163Jul 11, 2024Updated last year
- It is an Android-based application that enables managing hotspot properties through a web interface, providing mobile routing functionali…☆156Dec 19, 2024Updated last year
- Imagine building a whole operating system around just your notes.☆80Feb 5, 2025Updated last year
- ☆141May 8, 2024Updated last year
- A code repository designed to show the best GitHub has to offer.☆165Jun 30, 2024Updated last year
- ☆105Jan 24, 2025Updated last year
- ☆246Nov 24, 2024Updated last year
- [ICLR'24] Democratizing Fine-grained Visual Recognition with Large Language Models☆189Jul 15, 2024Updated last year
- 莫甘娜问卷表单编辑器，低代码快速搭建表单，AI表单生成，表单数据搜集统计☆147Aug 9, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆175Feb 21, 2025Updated last year
- Evaluation of Text-to-Video Generation Models: A Dynamics Perspective[NeurIPS 2024].☆274Dec 3, 2024Updated last year
- A curated list of awesome papers related to adversarial attacks and defenses for information retrieval. If I missed any papers, feel free…☆220Jul 11, 2024Updated last year
- 🔗 Serverless blockchain analytics pipeline on AWS - Extract, process and visualize Ethereum data using Kinesis, Lambda, Redshift Serverl…☆102Oct 5, 2023Updated 2 years ago
- Inscriptions on CoreDao, powered by Insdexer.☆147Mar 20, 2024Updated 2 years ago
- AI-powered document summarization engine that transforms lengthy texts into crystallized insights☆145Nov 5, 2024Updated last year
- ☆120Sep 30, 2024Updated last year
- AI solution for Patent Classification☆142Jun 29, 2020Updated 5 years ago
- ☆286Jul 6, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A python package that integrate algorithms and various machine learning approaches to extract features (genes) effective for classificati…☆251Jan 15, 2026Updated 2 months ago
- An extension for Visual Studio Code that integrates the power of OpenAI's GPT models into VSCode.☆160Mar 24, 2024Updated 2 years ago
- This script allows the server to isolate computational resources through LXD and pre-install PyTorch in order to share GPUs among differe…☆91Apr 13, 2024Updated 2 years ago
- ☆142Nov 13, 2024Updated last year
- Advanced Unsupervised Image Enhancement with GAN☆246Nov 11, 2024Updated last year
- Dive into Nature Simulation v1, a dynamic ecosystem game. Experience life's balance with interactive controls and stunning visuals of flo…☆248Dec 23, 2024Updated last year
- ☆251Feb 11, 2025Updated last year
- C++ codes for FDTD Maxwell's equation.☆161Jun 11, 2023Updated 2 years ago
- User Identity Scaffolding for Multiple OIDC Authentications for User☆95Jun 14, 2025Updated 10 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- check☆100Dec 12, 2025Updated 4 months ago
- ☆142Apr 26, 2024Updated last year
- YiTu is an easy-to-use runtime to fully exploit the hybrid parallelism of different hardwares (e.g., GPU) to efficiently support the exec…☆254Jan 7, 2026Updated 3 months ago
- 最终幻想14英文笔记☆96May 25, 2024Updated last year
- ☆167Jul 14, 2024Updated last year
- ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://arxiv.org/abs/2311.098…☆315Jul 31, 2025Updated 8 months ago
- ☆241Jul 5, 2024Updated last year