kemingy / vllm-envLinks
setup the env for vllm users
☆16Updated last year
Alternatives and similar repositories for vllm-env
Users that are interested in vllm-env are comparing it to the libraries listed below
Sorting:
- A collection of reproducible inference engine benchmarks☆34Updated 6 months ago
- Evaluation for AI apps and agent☆43Updated last year
- A memory efficient DLRM training solution using ColossalAI☆106Updated 2 years ago
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆275Updated last year
- ☆16Updated last year
- Evaluation of bm42 sparse indexing algorithm☆70Updated last year
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆73Updated last year
- Sentence Embedding as a Service☆15Updated 3 months ago
- ☆85Updated 2 years ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- Evaluating tool-augmented LLMs in conversation settings☆88Updated last year
- fastertransformer for codegeex model☆65Updated 2 years ago
- Large-scale exact string matching tool☆17Updated 7 months ago
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆29Updated 6 months ago
- ☆26Updated 2 months ago
- Yet another coding assistant powered by LLM.☆16Updated last year
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆131Updated last month
- A lightweight script for processing HTML page to markdown format with support for code blocks☆80Updated last year
- ☆27Updated 2 years ago
- Benchmark suite for LLMs from Fireworks.ai☆82Updated last week
- Open Implementations of LLM Analyses☆107Updated last year
- Deploy ChatGLM on Modelz☆16Updated 2 years ago
- OVALChat is a customizable Web app aimed at conducting user studies with chatbots☆28Updated last year
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆90Updated last month
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22Updated 5 months ago
- Leveraging large language models for text-to-SQL synthesis, this project fine-tunes WizardLM/WizardCoder-15B-V1.0 with QLoRA on a custom …☆45Updated last year
- Benchmarking suite for popular AI APIs☆87Updated 8 months ago
- The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective☆62Updated 2 years ago
- Benchmark baseline for retrieval qa applications☆115Updated last year
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago