Qcompiler / vllm-mixed-precision
Support mixed-precsion inference with vllm
☆94Updated this week
Related projects ⓘ
Alternatives and complementary repositories for vllm-mixed-precision
- Mixed precision inference by Tensorrt-LLM☆93Updated 2 weeks ago
- This tool(enhance_long) aims to enhance the LlaMa2 long context extrapolation capability in the lowest-cost approach, preferably without …☆47Updated 11 months ago
- an Easy-to-use Tool for Comprehensive Response Evaluation of LLMs☆45Updated 3 weeks ago
- Empower Your Model with Longer and Better Context Comprehention☆50Updated last year
- ☆84Updated 2 weeks ago
- MIXQ: Taming Dynamic Outliers in Mixed-Precision Quantization by Online Prediction☆76Updated 2 weeks ago
- High performance rank executor for advertisement and recommendation system, implemented in C/C++ and support ensembled into Java/Scala ho…☆99Updated 8 months ago
- [NeurIPS 2024] EffiBench: Benchmarking the Efficiency of Automatically Generated Code☆56Updated last month
- Code of Journey to the Center of the Knowledge Neurons: Discoveries of Language-Independent Knowledge Neurons and Degenerate Knowledge Ne…☆33Updated 7 months ago
- [ACL'23] Code for "SANTA: Separate Strategies for Inaccurate and Incomplete Annotation Noise in Distantly-Supervised Named Entity Recogni…☆43Updated last year
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆120Updated last week
- Collecting personality-indicative data for role-playing agents.☆27Updated 3 months ago
- ☆43Updated last month
- ☆42Updated 9 months ago
- Corpus and Enhanced Pre-trained Models for EMNLP 2023 Findings Long Paper: "Multi-Stage Pre-training Enhanced by ChatGPT for Multi-Scenar…☆36Updated last year
- 使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力☆154Updated 3 months ago
- This repo contains my customised style python based plots for NLP papers, and includes my reproduction for my favourite papers' plots☆39Updated 8 months ago
- An Information Flow Perspective for Exploring Large Vision Language Models on Reasoning Tasks☆58Updated 2 weeks ago
- [EMNLP 2024 Findings] Official PyTorch Implementation of "Adaptive Contrastive Search: Uncertainty-Guided Decoding for Open-Ended Text Ge…☆49Updated last month
- [ICME 2024] Official Datasets and example of LLM-SAP: Large Language Model Situational Awareness Based Planning☆42Updated 2 months ago
- ☆26Updated last week
- ☆33Updated 2 years ago
- A collection of papers related to knowledge fusion☆63Updated last month
- ☆148Updated 6 months ago
- LLM Benchmark for Code☆33Updated 3 months ago
- Ein multimodaler, multi-intelligenter Entwicklungsrahmen☆56Updated this week
- ☆51Updated 4 months ago
- The implementation for ACL 2023 paper "Towards Robust Personalized Dialogue Generation via Order-Insensitive Representation Regularizatio…☆17Updated last year
- Code for ACL 2024 long paper: Are AI-Generated Text Detectors Robust to Adversarial Perturbations?☆28Updated 4 months ago