Alternatives and similar repositories for vllm-env:

Users that are interested in vllm-env are comparing it to the libraries listed below

• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆37Updated last year
• allenai / recoma
  Reasoning by Communicating with Agents
  ☆28Updated last week
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆15Updated 2 years ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆29Updated 2 weeks ago
• OrchardUniverse / litchi
  Yet another coding assistant powered by LLM.
  ☆16Updated 7 months ago
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 6 months ago
• laramohan / wikillm
  LLMs as Collaboratively Edited Knowledge Bases
  ☆45Updated last year
• iaramer / dobbi
  An open-source NLP library: fast text cleaning and preprocessing
  ☆23Updated 3 years ago
• anyscale / long-context-fine-tuning-blogpost
  ☆17Updated last year
• ninehills / langeval
  Evaluation for AI apps and agent
  ☆41Updated last year
• SqueezeAILab / Tool2Vec
  Efficient and Scalable Estimation of Tool Representations in Vector Space
  ☆23Updated 8 months ago
• hpcaitech / Titans
  A collection of models built with ColossalAI
  ☆32Updated 2 years ago
• nebula-contrib / nebulagraph-lite
  The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!
  ☆17Updated 11 months ago
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆22Updated last month
• Yard1 / Ray-DeepSpeed-Inference
  ☆17Updated 2 years ago
• miralab-ai / autoreason
  ☆41Updated 4 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated 11 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 5 months ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• lightblue-tech / lb-reranker
  ☆24Updated 3 months ago
• jina-ai / textbook
  distill chatGPT coding ability into small model (1b)
  ☆29Updated last year
• mixedbread-ai / binary-embeddings
  Showcase how mxbai-embed-large-v1 can be used to produce binary embedding. Binary embeddings enabled 32x storage savings and 40x faster r…
  ☆17Updated last year
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆27Updated last week
• stanford-oval / ovalchat
  OVALChat is a customizable Web app aimed at conducting user studies with chatbots
  ☆28Updated last year
• qdrant / bm42_eval
  Evaluation of bm42 sparse indexing algorithm
  ☆65Updated 9 months ago
• mrcabbage972 / simple-toolformer
  A Python implementation of Toolformer using Huggingface Transformers
  ☆14Updated 2 years ago
• SivilTaram / code-html-to-markdown
  A lightweight script for processing HTML page to markdown format with support for code blocks
  ☆79Updated last year
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 4 months ago
• facebookresearch / ToolVerifier
  This repository contains the ToolSelect dataset which was used to fine-tune Llama-2 70B for tool selection.
  ☆20Updated last year