A high-throughput and memory-efficient inference and serving engine for LLMs
☆53Dec 11, 2023Updated 2 years ago
Alternatives and similar repositories for vllm-release
Users that are interested in vllm-release are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain…☆17Feb 12, 2024Updated 2 years ago
- ☆13Aug 7, 2021Updated 5 years ago
- A Seneca.js plugin that validates messages using the joi module.☆10Jul 9, 2026Updated 2 months ago
- A portable kernel/userspace development framework☆23Jun 1, 2026Updated 3 months ago
- Tools for formatting large language model prompts.☆13Dec 19, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- Sentence Embedding as a Service☆15Jun 30, 2025Updated last year
- meta_llama_2finetuned_text_generation_summarization☆21Jul 21, 2023Updated 3 years ago
- PArallelLOOPgEneratoR: Threaded Loops Code Generation Infrastructure targeting Tensor Contraction Applications such as GEMMs, Convolution…☆19Aug 4, 2026Updated last month
- LLMs represent numbers on a helix and manipulate that helix to do addition.☆31Feb 4, 2025Updated last year
- Benchmark SGLang on SLURM☆24Apr 20, 2026Updated 5 months ago
- GitHub tool for CodeX Bot platform☆16May 4, 2023Updated 3 years ago
- Most basic AI Assistant demo derived from the DeepPavlov Dream AI Assistant.☆14May 22, 2023Updated 3 years ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 5 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆20Oct 23, 2023Updated 2 years ago
- ☆866Dec 8, 2023Updated 2 years ago
- Official inference library for Mistral models☆10,825Jun 16, 2026Updated 3 months ago
- Python 3 compatible softphone with support for audio streaming.☆14Apr 18, 2024Updated 2 years ago
- Add a watermark to your images upon upload. A sample paperclip processor that builds atop the thumbnailer processor.☆13May 11, 2012Updated 14 years ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- ☆15May 16, 2019Updated 7 years ago
- ☆50Updated this week
- writing really fast kernels☆20Sep 12, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Pytorch Implemenation of a SRGAN with regularization loss to stabilize GAN training. Work presented at the Japanese conference MIRU.☆12Oct 17, 2018Updated 7 years ago
- ☆15Jun 13, 2025Updated last year
- Bayesian Inverse Graphics for Few-Shot Concept Learning☆12Mar 16, 2025Updated last year
- ☆165Mar 5, 2021Updated 5 years ago
- Completed codelabs from the gRPC project.☆18Sep 2, 2026Updated 3 weeks ago
- Repo for the testing-genai workshop☆14May 8, 2025Updated last year
- Simulate System76 EC with area8051 emulator☆12Mar 2, 2024Updated 2 years ago
- ☆17Feb 6, 2018Updated 8 years ago
- ☆13Nov 28, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code-Langchain☆44Feb 20, 2024Updated 2 years ago
- Scrape and export data from the Open LLM Leaderboard.☆48Dec 17, 2024Updated last year
- Русско-Английский вокодер на GAN☆17Jun 15, 2021Updated 5 years ago
- A local inference engine for Apple silicon, built around the model.☆671Updated this week
- Get a mask and goggle for your avatar now! 为预防2020新型冠狀病毒肺炎，请积极佩戴口罩及护目镜。☆10Dec 25, 2024Updated last year
- Fancylit is a python module that contains pre-packaged Streamlit code to render fancy visualizations, run modeling tasks, and data explor…☆11Oct 19, 2021Updated 4 years ago
- ☆12Dec 8, 2020Updated 5 years ago