Alternatives and similar repositories for vllm-env:

Users that are interested in vllm-env are comparing it to the libraries listed below

• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆14Updated last year
• hpcaitech / Titans
  A collection of models built with ColossalAI
  ☆32Updated 2 years ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆36Updated last year
• allenai / recoma
  Reasoning by Communicating with Agents
  ☆24Updated 4 months ago
• mrcabbage972 / simple-toolformer
  A Python implementation of Toolformer using Huggingface Transformers
  ☆15Updated last year
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• qdrant / bm42_eval
  Evaluation of bm42 sparse indexing algorithm
  ☆64Updated 7 months ago
• zejunwang1 / fastMatch
  Large-scale exact string matching tool
  ☆15Updated 3 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆66Updated last week
• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆15Updated last year
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆101Updated 2 years ago
• tpoisonooo / kimi-chat-testdata
  kimi-chat 测试数据
  ☆7Updated last year
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆76Updated last year
• ninehills / langeval
  Evaluation for AI apps and agent
  ☆36Updated last year
• iaramer / dobbi
  An open-source NLP library: fast text cleaning and preprocessing
  ☆23Updated 3 years ago
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆84Updated last year
• laramohan / wikillm
  LLMs as Collaboratively Edited Knowledge Bases
  ☆44Updated 11 months ago
• FreedomIntelligence / GPT-API-Accelerate
  The "GPT-API-Accelerate" project provides a set of Python classes for accelerating the process of generating responses to prompts using t…
  ☆22Updated 4 months ago
• THUDM / Multilingual-GLM
  The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective
  ☆62Updated 2 years ago
• OpenBuddy / GrandSage
  ☆16Updated 8 months ago
• nyunAI / PruneGPT
  ☆53Updated 8 months ago
• SivilTaram / code-html-to-markdown
  A lightweight script for processing HTML page to markdown format with support for code blocks
  ☆78Updated 10 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated 9 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• Yard1 / Ray-DeepSpeed-Inference
  ☆17Updated last year
• mixedbread-ai / binary-embeddings
  Showcase how mxbai-embed-large-v1 can be used to produce binary embedding. Binary embeddings enabled 32x storage savings and 40x faster r…
  ☆15Updated 10 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆62Updated 10 months ago
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆40Updated last year
• SqueezeAILab / Tool2Vec
  Efficient and Scalable Estimation of Tool Representations in Vector Space
  ☆18Updated 5 months ago