Support mixed-precsion inference with vllm
☆85Jul 17, 2025Updated last year
Alternatives and similar repositories for vllm-mixed-precision
Users that are interested in vllm-mixed-precision are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Mixed precision inference by Tensorrt-LLM☆79Oct 23, 2024Updated 2 years ago
- It is an Android-based application that enables managing hotspot properties through a web interface, providing mobile routing functionali…☆156Jul 14, 2026Updated 3 months ago
- kight is a static analysis tool for c/c++ programs.☆213Dec 27, 2024Updated last year
- Official Implementation of AttentionShift: Iteratively Estimated Part-based Attention Map for Pointly Supervised Instance Segmentation☆155Oct 18, 2024Updated 2 years ago
- Imagine building a whole operating system around just your notes.☆79Feb 5, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A code repository designed to show the best GitHub has to offer.☆165Jun 30, 2024Updated 2 years ago
- An Workspace for HMI tools☆163Jul 11, 2024Updated 2 years ago
- ☆141May 8, 2024Updated 2 years ago
- Welcome to the 'Open-Alteryx-Macro' project. This project is aimed at providing an open-source solution for managing and updating Alteryx…☆156May 25, 2024Updated 2 years ago
- ☆105Jan 24, 2025Updated last year
- ☆121Sep 30, 2024Updated 2 years ago
- ☆142Nov 13, 2024Updated last year
- ☆175Feb 21, 2025Updated last year
- Analysis and visualization of multi-omics data. In ongoing development: multi-modal fusion, sparse learning, and spatio-temporal effects.…☆206Jan 15, 2026Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Inscriptions on CoreDao, powered by Insdexer.☆147Mar 20, 2024Updated 2 years ago
- ☆246Nov 24, 2024Updated last year
- 🔗 Serverless blockchain analytics pipeline on AWS - Extract, process and visualize Ethereum data using Kinesis, Lambda, Redshift Serverl…☆103Oct 5, 2023Updated 3 years ago
- Book Recommendation System☆238May 2, 2024Updated 2 years ago
- ☆132Feb 15, 2025Updated last year
- 莫甘娜问卷表单编辑器，低代码快速搭建表单，AI表单生成，表单数据搜集统计☆147Jun 21, 2026Updated 4 months ago
- DP vs Recursion Code☆157Oct 14, 2026Updated 2 weeks ago
- A python package that integrate algorithms and various machine learning approaches to extract features (genes) effective for classificati…☆251Jan 15, 2026Updated 9 months ago
- AI-powered document summarization engine that transforms lengthy texts into crystallized insights☆146Nov 5, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An extension for Visual Studio Code that integrates the power of OpenAI's GPT models into VSCode.☆160Mar 24, 2024Updated 2 years ago
- Advanced Unsupervised Image Enhancement with GAN☆247Nov 11, 2024Updated last year
- 最终幻想14英文笔记☆96May 25, 2024Updated 2 years ago
- ☆250Feb 11, 2025Updated last year
- GUNDAM is a data management system that prioritizes data using language models.☆187Aug 2, 2025Updated last year
- MetaTrx: Comprehensive Cross-Species Transcriptome Analysis☆118Jun 4, 2024Updated 2 years ago
- ☆134Sep 24, 2024Updated 2 years ago
- ☆142Apr 26, 2024Updated 2 years ago
- [ICLR'24] Democratizing Fine-grained Visual Recognition with Large Language Models☆188Jul 15, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆296Sep 14, 2025Updated last year
- Dive into Nature Simulation v1, a dynamic ecosystem game. Experience life's balance with interactive controls and stunning visuals of flo…☆248Dec 23, 2024Updated last year
- ☆169Jul 14, 2024Updated 2 years ago
- Evaluation of Text-to-Video Generation Models: A Dynamics Perspective[NeurIPS 2024].☆274Dec 3, 2024Updated last year
- AI solution for Patent Classification☆144Jun 29, 2020Updated 6 years ago
- User Identity Scaffolding for Multiple OIDC Authentications for User☆95Jun 14, 2025Updated last year
- This script allows the server to isolate computational resources through LXD and pre-install PyTorch in order to share GPUs among differe…☆91Apr 13, 2024Updated 2 years ago