Alternatives and similar repositories for vllm-env:

Users that are interested in vllm-env are comparing it to the libraries listed below

• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆15Updated 2 years ago
• hpcaitech / Titans
  A collection of models built with ColossalAI
  ☆32Updated 2 years ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆36Updated last year
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• laramohan / wikillm
  LLMs as Collaboratively Edited Knowledge Bases
  ☆45Updated last year
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆81Updated 3 months ago
• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆14Updated last year
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆42Updated last year
• qdrant / bm42_eval
  Evaluation of bm42 sparse indexing algorithm
  ☆65Updated 9 months ago
• SqueezeAILab / Tool2Vec
  Efficient and Scalable Estimation of Tool Representations in Vector Space
  ☆23Updated 7 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 4 months ago
• iaramer / dobbi
  An open-source NLP library: fast text cleaning and preprocessing
  ☆23Updated 3 years ago
• Narsil / bloomserver
  ☆39Updated 2 years ago
• mrcabbage972 / simple-toolformer
  A Python implementation of Toolformer using Huggingface Transformers
  ☆15Updated 2 years ago
• FreedomIntelligence / GPT-API-Accelerate
  The "GPT-API-Accelerate" project provides a set of Python classes for accelerating the process of generating responses to prompts using t…
  ☆23Updated 6 months ago
• OpenBuddy / GrandSage
  ☆16Updated 10 months ago
• allenai / recoma
  Reasoning by Communicating with Agents
  ☆26Updated 6 months ago
• ninehills / langeval
  Evaluation for AI apps and agent
  ☆39Updated last year
• BlackHC / llmtracer
  Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
  ☆14Updated last month
• SivilTaram / code-html-to-markdown
  A lightweight script for processing HTML page to markdown format with support for code blocks
  ☆79Updated last year
• anyscale / long-context-fine-tuning-blogpost
  ☆18Updated last year
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆84Updated last year
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆55Updated last year
• EasyShopAI / rag-lab
  Lighter, cheaper and faster RAG toolkit (Graph RAG) supported by TargetPilot
  ☆45Updated 6 months ago
• tensorchord / llmspec
  OpenAI compatible API for open source LLMs
  ☆15Updated last year
• THUDM / Multilingual-GLM
  The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective
  ☆62Updated 2 years ago
• bentoml / llm-bench
  ☆49Updated 4 months ago
• aws-neuron / aws-neuron-reference-for-megatron-lm
  ☆14Updated last year
• tpoisonooo / kimi-chat-testdata
  kimi-chat 测试数据
  ☆7Updated last year