kemingy / vllm-env

Related projects ⓘ

Alternatives and complementary repositories for vllm-env

• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆14Updated last year
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆27Updated last year
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆18Updated 4 months ago
• BlackHC / llmtracer
  Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
  ☆14Updated 10 months ago
• hpcaitech / Titans
  A collection of models built with ColossalAI
  ☆32Updated 2 years ago
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 3 years ago
• tensorchord / llmspec
  OpenAI compatible API for open source LLMs
  ☆15Updated last year
• bentoml / llm-bench
  ☆35Updated this week
• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆15Updated last year
• stanford-oval / ovalchat
  OVALChat is a customizable Web app aimed at conducting user studies with chatbots
  ☆27Updated 10 months ago
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆100Updated 2 years ago
• bentoml / simple_di
  Simple dependency injection framework for Python
  ☆20Updated 6 months ago
• ajtejankar / mixtral-vis-moe
  Visualize expert firing frequencies across sentences in the Mixtral MoE model
  ☆17Updated 10 months ago
• skypilot-org / sky-llama
  ☆26Updated last year
• aws-neuron / aws-neuron-reference-for-megatron-lm
  ☆14Updated last year
• SqueezeAILab / Tool2Vec
  Efficient and Scalable Estimation of Tool Representations in Vector Space
  ☆16Updated 2 months ago
• codefuse-ai / D2LLM
  ☆22Updated 3 months ago
• mixedbread-ai / binary-embeddings
  Showcase how mxbai-embed-large-v1 can be used to produce binary embedding. Binary embeddings enabled 32x storage savings and 40x faster r…
  ☆16Updated 7 months ago
• MooreThreads / TurboRAG
  ☆33Updated this week
• ninehills / langeval
  Evaluation for AI apps and agent
  ☆35Updated 10 months ago
• SivilTaram / code-html-to-markdown
  A lightweight script for processing HTML page to markdown format with support for code blocks
  ☆73Updated 7 months ago
• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆16Updated last year
• cxcscmu / RAGViz
  Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]
  ☆46Updated this week
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆58Updated 2 weeks ago
• zejunwang1 / fastMatch
  Large-scale exact string matching tool
  ☆15Updated last week
• OpenBuddy / GrandSage
  ☆16Updated 5 months ago
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆16Updated 4 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed
  ☆37Updated this week
• AUGMXNT / llm-experiments
  Experiments w/ ChatGPT, LangChain, local LLMs
  ☆24Updated last year