setup the env for vllm users
☆16Oct 31, 2023Updated 2 years ago
Alternatives and similar repositories for vllm-env
Users that are interested in vllm-env are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Benchmark PyTorch Custom Operators☆14Jul 6, 2023Updated 3 years ago
- A rust implementation for user space file system (FUSE) for cloud object storage like Gcs and S3☆15Apr 16, 2023Updated 3 years ago
- ☆10Oct 15, 2020Updated 5 years ago
- Showcasing various NLP Downstream tasks Training with pre-trained Language models using Pytorch Lightning☆13Aug 7, 2022Updated 3 years ago
- Open Source Text Embedding Models with OpenAI Compatible API☆169Jul 13, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Calculate SHA256 checksums of objects on Amazon S3.☆11Sep 6, 2024Updated last year
- asyncbolt Bolt client/server protocol for Python asyncio☆13Dec 14, 2017Updated 8 years ago
- Anomaly detection in time series of graph data☆11Dec 3, 2013Updated 12 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆131Jun 25, 2024Updated 2 years ago
- CuteRest is a REST client tool dedicated for JSON☆11Dec 12, 2023Updated 2 years ago
- Patient Letter Generation☆12Aug 22, 2024Updated last year
- A simple web app where users click on images to segment objects using SAM and visualize masks on a HTML Canvas.☆16May 17, 2026Updated 2 months ago
- Helper methods for Pandas Series and DataFrames to calculate numerically derivative and integral☆11Jun 7, 2019Updated 7 years ago
- SGQuant: Squeezing the Last Bit on Graph Neural Networks with Specialized Quantization☆11Aug 12, 2020Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Multiple correspondence analysis☆10Apr 2, 2015Updated 11 years ago
- Fast and memory-efficient exact attention ported to rocm☆14Dec 1, 2023Updated 2 years ago
- ☆14May 12, 2025Updated last year
- Python package for rematerialization-aware gradient checkpointing☆27Oct 31, 2023Updated 2 years ago
- Github repo for the Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification, code and data | Paper: https://ar…☆14Apr 6, 2023Updated 3 years ago
- This is a read-only mirror of the CRAN R package repository. forestploter — Create a Flexible Forest Plot. Homepage: https://github.com…☆14Apr 27, 2026Updated 2 months ago
- demo backend with flask and neo4j☆12Jul 3, 2017Updated 9 years ago
- ☆10Sep 24, 2017Updated 8 years ago
- ☆12Apr 23, 2022Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Some microbenchmarks and design docs before commencement☆11Feb 1, 2021Updated 5 years ago
- Python script to download tweets☆12Dec 13, 2022Updated 3 years ago
- XDP-based packet manipulation tool with Prometheus metrics☆13Sep 10, 2019Updated 6 years ago
- japanese date parser for nodejs☆11Feb 4, 2024Updated 2 years ago
- Fast inference for high-quality simply-connected superpixels (a gpu implementation) Based on [Freifeld et al., ICIP '15]☆12Jul 11, 2020Updated 6 years ago
- 论文Low-Shot Learning with Imprinted Weights 的keras 版简要实现;☆15Dec 28, 2018Updated 7 years ago
- Evaluation repository of wikipedia index with Dria☆10Mar 14, 2024Updated 2 years ago
- Building Blocks for the VR Web☆10Aug 7, 2019Updated 6 years ago
- Useful library for dealing with tasks DAG in Celery☆15Oct 10, 2017Updated 8 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆12Jul 26, 2016Updated 10 years ago
- Graphical techniques for text mining.☆19Jun 12, 2015Updated 11 years ago
- [EMNLP 2023] Official repository for Dialogue Chain-of-Thought Distillation (DONUT & DOCTOR)☆11Nov 15, 2023Updated 2 years ago
- a KaTeX plugin for Markdown-it☆13Jun 3, 2024Updated 2 years ago
- Scripts and utilities to install and manage KVM machines☆10Jul 9, 2026Updated 2 weeks ago
- 【工具】基于selenium的微博搜索爬虫☆13Jun 25, 2014Updated 12 years ago
- ☆18Nov 25, 2020Updated 5 years ago