A high-throughput and memory-efficient inference and serving engine for LLMs
☆53Dec 11, 2023Updated 2 years ago
Alternatives and similar repositories for vllm-release
Users that are interested in vllm-release are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Updated this week
- CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models☆11Jul 1, 2023Updated 3 years ago
- A quick way to get started with Transformer Lens☆15Dec 13, 2023Updated 2 years ago
- The Shifted and The Overlooked: A Task-oriented Investigation of User-GPT Interactions (EMNLP 2023))☆13Dec 21, 2023Updated 2 years ago
- ☆13Aug 7, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tools for formatting large language model prompts.☆13Dec 19, 2023Updated 2 years ago
- Sentence Embedding as a Service☆15Jun 30, 2025Updated last year
- meta_llama_2finetuned_text_generation_summarization☆21Jul 21, 2023Updated 3 years ago
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆29Updated this week
- Benchmark SGLang on SLURM☆24Apr 20, 2026Updated 5 months ago
- GitHub tool for CodeX Bot platform☆16May 4, 2023Updated 3 years ago
- Animal Video Analysis Tool (AVAT)☆14May 12, 2026Updated 5 months ago
- Ongoing research training transformer models at scale☆18Jul 27, 2023Updated 3 years ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆20Oct 23, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆866Dec 8, 2023Updated 2 years ago
- ☆11Apr 3, 2023Updated 3 years ago
- OpenSource deployment made easy☆10Jun 13, 2015Updated 11 years ago
- Official inference library for Mistral models☆10,822Jun 16, 2026Updated 3 months ago
- ☆32Jun 6, 2024Updated 2 years ago
- Python 3 compatible softphone with support for audio streaming.☆14Apr 18, 2024Updated 2 years ago
- Tensor library for machine learning☆16Jul 13, 2023Updated 3 years ago
- chatGPT 'Autonomous Agent' in Node.js, written/runs in Termux. Sandboxed REPL access, Termux:API interface, chain-of-thought Question-Obs…☆17May 12, 2023Updated 3 years ago
- ☆15May 16, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Databutton MCP Server☆25Apr 7, 2025Updated last year
- writing really fast kernels☆20Sep 12, 2026Updated last month
- Pytorch Implemenation of a SRGAN with regularization loss to stabilize GAN training. Work presented at the Japanese conference MIRU.☆12Oct 17, 2018Updated 7 years ago
- ☆15Jun 13, 2025Updated last year
- SmartThings Lutron Integration☆12Nov 21, 2016Updated 9 years ago
- Plugin for Isochronic Tone Modulation in Audacity☆12Apr 2, 2019Updated 7 years ago
- ☆17Feb 6, 2018Updated 8 years ago
- Code-Langchain☆45Feb 20, 2024Updated 2 years ago
- Scrape and export data from the Open LLM Leaderboard.☆48Dec 17, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Task management for AI agents☆16Jun 25, 2025Updated last year
- Get a mask and goggle for your avatar now! 为预防2020新型冠狀病毒肺炎，请积极佩戴口罩及护目镜。☆10Dec 25, 2024Updated last year
- Visual Object Tracking: The Initialisation Problem☆14Nov 2, 2022Updated 3 years ago
- MelGAN and Tacotron 2 in PyTorch☆11Oct 22, 2019Updated 6 years ago
- ☆12Dec 8, 2020Updated 5 years ago
- handle push notifications & other stuff☆10May 22, 2023Updated 3 years ago
- A simple program scheduler for your code on different devices.☆12Mar 8, 2026Updated 7 months ago