Alternatives and similar repositories for vllm-env:

Users that are interested in vllm-env are comparing it to the libraries listed below

• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆15Updated last year
• hpcaitech / Titans
  A collection of models built with ColossalAI
  ☆32Updated 2 years ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆36Updated last year
• SqueezeAILab / Tool2Vec
  Efficient and Scalable Estimation of Tool Representations in Vector Space
  ☆21Updated 6 months ago
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 4 years ago
• allenai / recoma
  Reasoning by Communicating with Agents
  ☆25Updated 5 months ago
• ninehills / langeval
  Evaluation for AI apps and agent
  ☆36Updated last year
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 3 months ago
• CodeGeeX / codegeex-fastertransformer
  fastertransformer for codegeex model
  ☆63Updated last year
• skypilot-org / sky-llama
  ☆28Updated last year
• zejunwang1 / fastMatch
  Large-scale exact string matching tool
  ☆15Updated this week
• OrchardUniverse / litchi
  Yet another coding assistant powered by LLM.
  ☆15Updated 6 months ago
• tpoisonooo / kimi-chat-testdata
  kimi-chat 测试数据
  ☆7Updated last year
• mixedbread-ai / binary-embeddings
  Showcase how mxbai-embed-large-v1 can be used to produce binary embedding. Binary embeddings enabled 32x storage savings and 40x faster r…
  ☆15Updated 11 months ago
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated 9 months ago
• laramohan / wikillm
  LLMs as Collaboratively Edited Knowledge Bases
  ☆44Updated last year
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆103Updated 2 years ago
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 4 months ago
• SivilTaram / code-html-to-markdown
  A lightweight script for processing HTML page to markdown format with support for code blocks
  ☆79Updated 10 months ago
• ray-project / distml
  Distributed ML Optimizer
  ☆30Updated 3 years ago
• iaramer / dobbi
  An open-source NLP library: fast text cleaning and preprocessing
  ☆23Updated 3 years ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆25Updated 4 months ago
• wangrui6 / Zhihu-KOL
  ☆31Updated last year
• OpenBuddy / GrandSage
  ☆16Updated 9 months ago
• THUDM / Multilingual-GLM
  The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective
  ☆62Updated 2 years ago
• bentoml / llm-bench
  ☆48Updated 3 months ago
• OpenBMB / cpm_kernels
  ☆23Updated last year
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆63Updated 11 months ago