A high-throughput and memory-efficient inference and serving engine for LLMs
☆11Sep 4, 2025Updated 6 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- ☆12Dec 19, 2024Updated last year
- The largest open corpus of .docx files for document processing research☆45Jan 22, 2026Updated last month
- Frontend (and soon also midleware and backend) for a new, opensource image generation platform.☆14Nov 5, 2022Updated 3 years ago
- ☆11Oct 11, 2023Updated 2 years ago
- A sample app to debug and validate cellular modems on balena devices☆13Jun 5, 2019Updated 6 years ago
- [EMNLP 2022] RLET: A Reinforcement Learning Based Approach for Explainable QA with Entailment Trees☆11Jul 15, 2023Updated 2 years ago
- This Repo Contains Script To Fine Tune Open Source Models Using Unsloth by using UI with simple click and progress☆11Oct 3, 2024Updated last year
- React 0.13 with ES6, Immutable.js and Flux, Isomorphic as well☆11Mar 10, 2015Updated 10 years ago
- ☆16Jul 29, 2025Updated 7 months ago
- Code for data reduction and analysis of Galaxy Zoo 2☆14May 20, 2016Updated 9 years ago
- notes for software engineers getting up to speed on new AI developments. Serves as datastore for https://latent.space writing, and produc…☆10Dec 25, 2024Updated last year
- Generic build server☆64May 25, 2014Updated 11 years ago
- ☆13May 3, 2023Updated 2 years ago
- ☆12Updated this week
- Unofficial package to easily interact with the Kits.AI API☆10Mar 1, 2024Updated 2 years ago
- Implementation of IntelliJ IDEA code completion plugin using a local LLM.☆18Feb 9, 2026Updated last month
- Website to view yale clubs and events☆15Feb 20, 2026Updated 2 weeks ago
- ☆14Jun 28, 2023Updated 2 years ago
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 2 years ago
- NodeJS SDK for the Sellix Developers API (developers.sellix.io). Quickly get started and create products, payments and more using NodeJS.☆11Jan 5, 2024Updated 2 years ago
- ☆11Feb 3, 2025Updated last year
- Yet another isomorphic react boilerplate. This one does not require node on server.☆10Apr 4, 2017Updated 8 years ago
- 🚀 Automated deployment stack for AMD MI300 GPUs with optimized ML/DL frameworks and HPC-ready configurations☆12Nov 30, 2024Updated last year
- This is a cog implementation of StableLM☆17Jun 6, 2023Updated 2 years ago
- [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers☆15Feb 12, 2026Updated 3 weeks ago
- Caching for Graphql Resolvers☆19Nov 21, 2019Updated 6 years ago
- a temporal graph analytics library based on Flink Stateful Functions☆11Jun 8, 2023Updated 2 years ago
- A package to interact with poe.com☆12Mar 16, 2023Updated 2 years ago
- A simple one file python script that executes AI processes defined in YML.☆14Mar 26, 2023Updated 2 years ago
- Port of Facebook's LLaMA model in C/C++☆12Updated this week
- Code for Blog Post: Can Better Cold-Start Strategies Improve RL Training for LLMs?☆19Mar 9, 2025Updated last year
- arXiv-Chat: An AI research assistant and Discord bot☆13Jul 16, 2023Updated 2 years ago
- ☆13Oct 25, 2024Updated last year
- ☆18Dec 20, 2025Updated 2 months ago
- ☆20Oct 2, 2024Updated last year
- A serverless application that uses AnimateDiff to run a Text-to-Video task on RunPod.☆20Mar 8, 2024Updated 2 years ago
- ☆15Nov 7, 2022Updated 3 years ago
- multilabel categorical crossentropy☆15Apr 26, 2020Updated 5 years ago
- Vagrantfile and Playbook to spin up ansible/Tower.☆35May 21, 2018Updated 7 years ago