kemingy / vllm-env
setup the env for vllm users
☆16Updated last year
Alternatives and similar repositories for vllm-env:
Users that are interested in vllm-env are comparing it to the libraries listed below
- Sentence Embedding as a Service☆15Updated last year
- Deploy ChatGLM on Modelz☆15Updated 2 years ago
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆36Updated last year
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated last year
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- A collection of models built with ColossalAI☆32Updated 2 years ago
- Efficient and Scalable Estimation of Tool Representations in Vector Space☆22Updated 6 months ago
- LLMs as Collaboratively Edited Knowledge Bases☆44Updated last year
- kimi-chat 测试数据☆7Updated last year
- Evaluation for AI apps and agent☆36Updated last year
- Manages vllm-nccl dependency☆17Updated 9 months ago
- ☆16Updated 9 months ago
- ☆17Updated last year
- A Python implementation of Toolformer using Huggingface Transformers☆15Updated 2 years ago
- Nexusflow function call, tool use, and agent benchmarks.☆19Updated 3 months ago
- ☆84Updated last year
- OVALChat is a customizable Web app aimed at conducting user studies with chatbots☆29Updated last year
- Leveraging large language models for text-to-SQL synthesis, this project fine-tunes WizardLM/WizardCoder-15B-V1.0 with QLoRA on a custom …☆43Updated last year
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆65Updated 11 months ago
- Reasoning by Communicating with Agents☆25Updated 5 months ago
- Data preparation code for CrystalCoder 7B LLM☆44Updated 10 months ago
- A memory efficient DLRM training solution using ColossalAI☆103Updated 2 years ago
- Score LLM pretraining data with classifiers☆54Updated last year
- Evaluation of bm42 sparse indexing algorithm☆64Updated 8 months ago
- The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective☆62Updated 2 years ago
- An open-source NLP library: fast text cleaning and preprocessing☆23Updated 3 years ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆25Updated 4 months ago
- fastertransformer for codegeex model☆63Updated last year