kemingy / vllm-env
setup the env for vllm users
☆16Updated last year
Alternatives and similar repositories for vllm-env:
Users that are interested in vllm-env are comparing it to the libraries listed below
- Sentence Embedding as a Service☆14Updated last year
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆36Updated last year
- A collection of models built with ColossalAI☆32Updated 2 years ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated last year
- Deploy ChatGLM on Modelz☆15Updated last year
- Reasoning by Communicating with Agents☆24Updated 4 months ago
- Evaluation of bm42 sparse indexing algorithm☆64Updated 7 months ago
- ☆16Updated 8 months ago
- Open Implementations of LLM Analyses☆98Updated 4 months ago
- Evaluation for AI apps and agent☆36Updated last year
- RWKV (Receptance Weighted Key Value) is a RNN with Transformer-level performance☆39Updated 2 years ago
- ☆17Updated last year
- LLMs as Collaboratively Edited Knowledge Bases☆44Updated 11 months ago
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆76Updated last year
- An open-source NLP library: fast text cleaning and preprocessing☆23Updated 3 years ago
- Data preparation code for CrystalCoder 7B LLM☆44Updated 9 months ago
- OpenAI compatible API for open source LLMs☆15Updated last year
- Efficient and Scalable Estimation of Tool Representations in Vector Space☆18Updated 5 months ago
- ☆18Updated 11 months ago
- kimi-chat 测试数据☆7Updated last year
- fastertransformer for codegeex model☆64Updated last year
- Data preparation code for Amber 7B LLM☆85Updated 9 months ago
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆61Updated 10 months ago
- The driver for LMCache core to run in vLLM☆26Updated 2 weeks ago
- ☆52Updated 8 months ago
- The "GPT-API-Accelerate" project provides a set of Python classes for accelerating the process of generating responses to prompts using t…☆22Updated 4 months ago
- Large-scale exact string matching tool☆15Updated 3 months ago
- Trying to deconstruct RWKV in understandable terms☆14Updated last year
- The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective☆62Updated 2 years ago
- Advanced Reasoning Benchmark Dataset for LLMs☆46Updated last year