A high-throughput and memory-efficient inference and serving engine for LLMs
☆18Nov 24, 2023Updated 2 years ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Shaping Language Models with Cognitive Insights☆15Feb 29, 2024Updated 2 years ago
- the benchmark for finance☆11Jul 4, 2023Updated 3 years ago
- ICE-PIXIU:A Cross-Language Financial Megamodeling Framework☆19Dec 4, 2024Updated last year
- Just awful. | The counter part of awesome.☆10Apr 25, 2018Updated 8 years ago
- This is AlpaGasus2-QLoRA based on LLaMA2 with AlpaGasus mechanism using QLoRA!☆15Nov 22, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆13Jan 15, 2026Updated 10 months ago
- ☆16Apr 17, 2026Updated 7 months ago
- ☆21May 22, 2023Updated 3 years ago
- ☆14Jun 11, 2024Updated 2 years ago
- ☆10May 23, 2025Updated last year
- A Multi-Format Transfer Learning Model for Event Argument Extraction via Variational Information Bottleneck☆10Sep 9, 2022Updated 4 years ago
- accelerate generating vector by using onnx model☆18Jan 23, 2024Updated 2 years ago
- Keras library for building (Universal) Transformers, facilitating BERT and GPT models☆11Jan 29, 2019Updated 7 years ago
- ☆11Mar 12, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆11Jan 6, 2024Updated 2 years ago
- ☆43May 9, 2024Updated 2 years ago
- 📰 Named entitity recognition (NER) and Entity linking (EL) on the dataset of Patents☆16Jun 5, 2022Updated 4 years ago
- Website for the EPFL course PHYS-642: Statistical Physics for Optimization and Learning☆11Sep 27, 2023Updated 3 years ago
- ☆18Jul 28, 2026Updated 3 months ago
- ☆14Jul 11, 2024Updated 2 years ago
- ☆12Jun 19, 2025Updated last year
- 针对最经典的表格型Q learning算法进行了复现,能够支持gym中大多数的离散动作和状态空间的环境,譬如CliffWalking-v0。☆10Jan 2, 2021Updated 5 years ago
- ☆13Dec 22, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- WPF编写的词向量可视化工具,比较word2vec, glove, fastText的不同☆31Mar 6, 2017Updated 9 years ago
- Automated auditing pipeline for LLM and agent benchmarks — surfaces task ambiguity, environment conflicts, and evaluation bugs.☆17May 27, 2026Updated 5 months ago
- This repository presents a comprehensive solution to the hand-eye calibration problem, a fundamental challenge in robotics and computer v…☆12May 18, 2026Updated 6 months ago
- 🔱 A naive tool for AssetBundles exploring.☆11Nov 22, 2022Updated 3 years ago
- Official Codebase for .☆18Oct 25, 2026Updated 3 weeks ago
- ☆16Aug 18, 2026Updated 3 months ago
- implementation of http://arxiv.org/pdf/1511.06391v4.pdf in keras☆13Oct 3, 2016Updated 10 years ago
- PDF table extraction☆10Dec 14, 2021Updated 4 years ago
- Does Socialization Emerge in AI Agent Society? A Case Study of Moltbook☆18Feb 17, 2026Updated 9 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Server for ZKML☆22Mar 5, 2023Updated 3 years ago
- Code for our EMNLP 2021 paper - Large-Scale Relation Learning for Question Answering over Knowledge Bases with Pre-trained Language Model…☆24Dec 8, 2021Updated 4 years ago
- Synthetic data generation for evaluating LLM symbolic and logic reasoning☆23Aug 13, 2026Updated 3 months ago
- ☆15Feb 17, 2025Updated last year
- ☆12Dec 8, 2022Updated 3 years ago
- 基于大模型ChatGLM,微调方式为LORA,集SFT、RM、PPO算法为一体项目☆14Jun 20, 2023Updated 3 years ago
- Code and data for paper named: Large language models for automatic equation discovery of nonlinear dynamics☆14Mar 6, 2025Updated last year
Are these results useful?