A high-throughput and memory-efficient inference and serving engine for LLMs
โ12Nov 27, 2023Updated 2 years ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ๐ค Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.โ10Mar 2, 2022Updated 4 years ago
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) trainingโ21Apr 26, 2022Updated 4 years ago
- Finetune Your Local LLMโ18Sep 23, 2023Updated 3 years ago
- โ12Mar 30, 2025Updated last year
- My notes and insights on designing self-evolving LLM agents.โ13Sep 3, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean โข AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Code for the paper: Proving Theorems Recursivelyโ12May 23, 2024Updated 2 years ago
- Codebase for fine-tuning Llama2 70B to generate math test questions and answers.โ10Aug 30, 2024Updated 2 years ago
- Instantly host your AI-generated portfolio! ๐ Pharaohfolio lets you paste HTML/CSS/JS code from any AI assistant (ChatGPT, Claude, Geminโฆโ12Jul 10, 2026Updated 4 months ago
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.โ20Jun 3, 2024Updated 2 years ago
- โ10Apr 28, 2026Updated 6 months ago
- Way to find and log actual localization keys into your i18n locale filesโ10Dec 3, 2014Updated 11 years ago
- Agentic AI Software Engineer that can convert natural language to executable codeโ12Aug 10, 2024Updated 2 years ago
- An efficient LinkedIn Messaging Bot that Messages a group of interests, YouTube link in Documentation for guidance.โ12Aug 25, 2021Updated 5 years ago
- FalkorDB documentation pagesโ16Updated this week
- End-to-end encrypted email - Proton Mail โข AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- โ14Nov 30, 2022Updated 3 years ago
- LTP: Megatron-LM componentโ15Sep 3, 2026Updated 2 months ago
- High quality icons that are easy to use with Bootstrap, other CSS frameworks and in any web projects.โ12Aug 12, 2013Updated 13 years ago
- AI Engineer Skills Beginners Project 1 - Chat with YouTubeโ13Nov 6, 2023Updated 3 years ago
- Template project for Go libraries.โ15Oct 25, 2026Updated 3 weeks ago
- Source for the application in the CodeTV Nginx seriesโ10Sep 17, 2013Updated 13 years ago
- Genie in the Box: Distill Whisper STT => Mistral-7B => Phind/Phind-CodeLlama-34B-v2 => GPT 3.5 => Coqui's TTS/OpenAI TTSโ15Apr 24, 2024Updated 2 years ago
- advanced code generator for John the Ripperโ13May 6, 2018Updated 8 years ago
- BLESuite is a Python package that provides an easier way to test Bluetooth Low Energy (BLE) deviceโ11Oct 6, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer โข AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Design assets and documentationโ17Oct 9, 2026Updated last month
- 8-bit Atari XL/XE platform emulatorโ10May 1, 2024Updated 2 years ago
- Codebase for paper titled: "Using Machine and Deep Learning Models, On-Chain Data, and Technical Analysis for Predicting Bitcoin Price Diโฆโ12Mar 20, 2025Updated last year
- ไนๅกๆ่ฒ้ถๆฎต ๆ็งไนฆ ๆด็ๆถ้โ16Jan 20, 2024Updated 2 years ago
- Video Frame data structures, originally part of rav1eโ19Aug 2, 2026Updated 3 months ago
- An ember-cli-deploy-plugin to upload an Ember App directly to a CouchDB cluster.โ13Nov 1, 2020Updated 6 years ago
- โ13Jul 6, 2026Updated 4 months ago
- exercise for transformers-benchmarks, add 3090 benchmarkโ13Feb 3, 2023Updated 3 years ago
- Ember addon for rAF batching Reads and Writes (replacement for ember-spaniel utils)โ13Mar 6, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient โข AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- โ14Dec 5, 2025Updated 11 months ago
- HTTP/S Service Monitor Script This Bash script periodically monitors the availability and content of web services (HTTP/HTTPS) specifiedโฆโ15Sep 29, 2025Updated last year
- Helper tools for developing ember-animated motionsโ17Apr 29, 2024Updated 2 years ago
- โ11Apr 17, 2023Updated 3 years ago
- Free and open fair-code licensed node based Workflow Automation Tool. Easily automate tasks across different services.โ11Jun 30, 2021Updated 5 years ago
- Run shell command through HTTP.โ15Oct 16, 2014Updated 12 years ago
- โ10Oct 1, 2023Updated 3 years ago
Are these results useful?