A high-throughput and memory-efficient inference and serving engine for LLMs
☆18Nov 24, 2023Updated 2 years ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is AlpaGasus2-QLoRA based on LLaMA2 with AlpaGasus mechanism using QLoRA!☆15Nov 22, 2023Updated 2 years ago
- Ultra-Fine Entity Typing with Weak Supervision from a Masked Language Model☆18Aug 2, 2021Updated 5 years ago
- this is based on the paper Chain-of-Retrieval Augmented Generation☆15Mar 29, 2025Updated last year
- Unsupervised tableQA and databaseQA on chinese finance question and tabular data☆13Apr 20, 2023Updated 3 years ago
- A Model Agnostic function to directly remove specified layers from the LLM☆10May 23, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆21May 22, 2023Updated 3 years ago
- ☆43May 9, 2024Updated 2 years ago
- A Multi-Format Transfer Learning Model for Event Argument Extraction via Variational Information Bottleneck☆10Sep 9, 2022Updated 4 years ago
- ChatYuan-7B☆13Jun 16, 2023Updated 3 years ago
- Some data science applications on the student mathematics performance data set from the 2010 KDD Cup.☆10Nov 27, 2014Updated 11 years ago
- ☆11Mar 12, 2021Updated 5 years ago
- 📰 Named entitity recognition (NER) and Entity linking (EL) on the dataset of Patents☆16Jun 5, 2022Updated 4 years ago
- ☆10Aug 15, 2023Updated 3 years ago
- Rust 官方周报（简体中文版）☆15Jul 15, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speech (ACL-IJCNLP 2021 Findings)☆13Jun 22, 2022Updated 4 years ago
- code for "Fine-grained Entity Typing via Label Reasoning" EMNLP2021☆13May 27, 2022Updated 4 years ago
- Qwen1.5大模型微调、基于PEFT框架LoRA微调，在数据集HC3-Chinese上实现文本分类。☆12Jun 29, 2024Updated 2 years ago
- this is a high performance cuda porting of cbow model of word2vec☆17Sep 14, 2014Updated 11 years ago
- Python implementation of Self-Organizing Maps using PyTorch☆12Apr 20, 2018Updated 8 years ago
- Unconditional Geomodeling related work (codes, data, and results)☆19Jan 4, 2023Updated 3 years ago
- ☆12Jun 19, 2025Updated last year
- Open-source Human Feedback Library☆11Oct 25, 2023Updated 2 years ago
- Zero-shot entity linking with less data☆15Aug 1, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆12Apr 29, 2024Updated 2 years ago
- implementation of http://arxiv.org/pdf/1511.06391v4.pdf in keras☆13Oct 3, 2016Updated 9 years ago
- LangChain DeepResearch: Autonomous recursive research powered by any LLM☆19Jun 23, 2026Updated 2 months ago
- [ACL'25 Oral] What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective☆75Jun 25, 2025Updated last year
- Code for paper "Open Relation and Event Type Discovery with Type Abstraction". EMNLP 22'☆15Nov 30, 2022Updated 3 years ago
- Does Socialization Emerge in AI Agent Society? A Case Study of Moltbook☆18Feb 17, 2026Updated 6 months ago
- An implementation for MLLM oversensitivity evaluation☆18Nov 16, 2024Updated last year
- The software associated with a paper accepted at EMNLP 2021 titled "Open Knowledge Graphs Canonicalization using Variational Autoencoders…☆16Sep 27, 2021Updated 4 years ago
- ☆12Dec 8, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Evaluation utilities based on SymPy.☆25Dec 12, 2024Updated last year
- Learning from Mixed Rollouts: Logit Fusion as a Bridge Between Imitation and Exploration☆18Feb 24, 2026Updated 6 months ago
- A highly contextualized retrieval system integrating Large Language Models (LLMs), embeddings, and a dynamic agent-driven framework. Supp…☆27May 21, 2026Updated 3 months ago
- 🔱 A naive tool for AssetBundles exploring.☆11Nov 22, 2022Updated 3 years ago
- Using tensorflow to create a recommendation engine with DNN☆16Jul 30, 2016Updated 10 years ago
- Public Evaluation Result Archieve for BFCL☆33Updated this week
- [CVPR'26] UniGame code implementation☆20Apr 21, 2026Updated 4 months ago