Qcompiler / MixQ_Tensorrt_LLM
Mixed precision inference by Tensorrt-LLM
☆93Updated 3 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for MixQ_Tensorrt_LLM
- Support mixed-precsion inference with vllm☆95Updated this week
- linkedin, seek job information crawler☆105Updated 3 weeks ago
- [ICME 2024] Official Datasets and example of LLM-SAP: Large Language Model Situational Awareness Based Planning☆42Updated 2 months ago
- ☆84Updated 2 weeks ago
- High performance rank executor for advertisement and recommendation system, implemented in C/C++ and support ensembled into Java/Scala ho…☆99Updated 8 months ago
- AutoRLAIF is a cutting-edge framework designed to revolutionize the fine-tuning of large language models through Reinforcement Learning …☆117Updated 2 weeks ago
- An open-source library with a powerful Contrastive Language-and-Motion (CLaM) pre-training evaluator☆126Updated 3 months ago
- An Information Flow Perspective for Exploring Large Vision Language Models on Reasoning Tasks☆58Updated 2 weeks ago
- ☆42Updated 9 months ago
- [EMNLP 2024 Findings] Official PyTorch Implementation of "Adaptive Contrastive Search: Uncertainty-Guided Decoding for Open-Ended Text Ge…☆49Updated last month
- 以jax为后端的类似keras的框架☆122Updated last year
- GAL-DAWN: An Novel High performance computing Library of Graph Algorithms based on DAWN, CUDA/C++☆115Updated 3 months ago
- ☆82Updated 3 months ago
- A 3D game involves melee combat and parkour system based on UE5.☆36Updated 5 months ago
- AutoAnys is an innovative, open-source Robotic Process Automation (RPA) platform designed to revolutionize the automation landscape. Buil…☆96Updated 3 months ago
- an Easy-to-use Tool for Comprehensive Response Evaluation of LLMs☆45Updated 3 weeks ago
- Collecting personality-indicative data for role-playing agents.☆27Updated 3 months ago
- ☆148Updated 6 months ago
- ☆104Updated last week
- ☆99Updated 7 months ago
- ☆33Updated 2 years ago
- Rethinking Video-Text Understanding Retrieval from Counterfactually Augmented Data☆48Updated 3 months ago
- ☆106Updated 3 weeks ago
- ☆142Updated 6 months ago
- ☆81Updated last month
- ☆33Updated 4 months ago
- [ICSE 2022] Explaining ML-powered Code Generation byReferring to Training Examples.☆47Updated last year
- ☆32Updated 3 months ago
- ☆177Updated last month