setup the env for vllm users
☆16Oct 31, 2023Updated 2 years ago
Alternatives and similar repositories for vllm-env
Users that are interested in vllm-env are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions☆21Apr 15, 2022Updated 3 years ago
- Benchmark PyTorch Custom Operators☆14Jul 6, 2023Updated 2 years ago
- Exposes batch message receives (recvmmsg)☆14Aug 15, 2025Updated 7 months ago
- Calculate SHA256 checksums of objects on Amazon S3.☆11Sep 6, 2024Updated last year
- Distributed Embeddable Database☆12Sep 25, 2020Updated 5 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- An example of graph embeddings for wikipedia page recommendations☆11Aug 26, 2021Updated 4 years ago
- Open Source Text Embedding Models with OpenAI Compatible API☆166Jul 13, 2024Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆132Jun 25, 2024Updated last year
- ☆13May 12, 2025Updated 10 months ago
- Final project for COS 521: Using Hokusai algorithm to approximate frequency counts of hashtags in twitter data stream.☆12Jan 13, 2015Updated 11 years ago
- Docker external graph driver extensions☆30Jan 15, 2016Updated 10 years ago
- Face detection using Multi-scale Block Local Binary Pattern algorithm - optimized with OpenCL/OpenMP - Depreciated - pls use convolutiona…☆11Jul 16, 2017Updated 8 years ago
- Use LD_PRELOAD to redirect socket ports or unix domain socket paths☆13Sep 29, 2020Updated 5 years ago
- Python package for rematerialization-aware gradient checkpointing☆27Oct 31, 2023Updated 2 years ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆44Jul 16, 2024Updated last year
- Multiple correspondence analysis☆10Apr 2, 2015Updated 10 years ago
- quick playground to animate pippin☆15Nov 11, 2024Updated last year
- Github repo for the Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification, code and data | Paper: https://ar…☆14Apr 6, 2023Updated 2 years ago
- Fast and memory-efficient exact attention ported to rocm☆13Dec 1, 2023Updated 2 years ago
- A shell script which creates and manages named overlayfs mounts backed by the contents from tar files.☆19Jul 6, 2016Updated 9 years ago
- A low-level cross platform GPU library☆20Nov 5, 2024Updated last year
- New York Times Scraper☆11Feb 19, 2024Updated 2 years ago
- Experimental process viewer which also supports AIX, Linux and Mac☆13Aug 19, 2025Updated 7 months ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- Setup an MCP server in 60 seconds.☆13Dec 12, 2024Updated last year
- Chinese version implementation of Generative Agents: Interactive Simulacra of Human Behavior☆86Sep 7, 2023Updated 2 years ago
- ☆10Sep 24, 2017Updated 8 years ago
- ☆15Jan 26, 2026Updated 2 months ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆16Updated this week
- A storage plugin that provided CRI-O/Podman with the ability to lazy mount nydus images.☆43May 12, 2025Updated 10 months ago
- A template to create your own literature survey engine☆11Mar 16, 2026Updated last week
- ☆13Aug 18, 2022Updated 3 years ago
- Some microbenchmarks and design docs before commencement☆11Feb 1, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Fast inference for high-quality simply-connected superpixels (a gpu implementation) Based on [Freifeld et al., ICIP '15]☆12Jul 11, 2020Updated 5 years ago
- Yet another parser for the ABC Notation☆11Mar 19, 2026Updated last week
- japanese date parser for nodejs☆11Feb 4, 2024Updated 2 years ago
- ☆17Jul 14, 2018Updated 7 years ago
- markdown中文技术文档编写规范☆15Jun 23, 2017Updated 8 years ago
- Useful library for dealing with tasks DAG in Celery☆15Oct 10, 2017Updated 8 years ago
- [EMNLP 2023] Official repository for Dialogue Chain-of-Thought Distillation (DONUT & DOCTOR)☆11Nov 15, 2023Updated 2 years ago