Alternatives and similar repositories for GenAIComps

Users that are interested in GenAIComps are comparing it to the libraries listed below

• opea-project / GenAIEval
  Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…
  ☆37Updated last week
• opea-project / GenAIExamples
  Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…
  ☆667Updated this week
• opea-project / docs
  This repo contains documents of the OPEA project
  ☆44Updated last week
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆180Updated 3 months ago
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆189Updated last week
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆491Updated last week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆128Updated last week
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆34Updated 5 months ago
• opea-project / GenAIStudio
  GenAI Studio is a low code platform to enable users to construct, evaluate, and benchmark GenAI applications. The platform also provide c…
  ☆47Updated last week
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆324Updated this week
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 5 months ago
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆192Updated this week
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆140Updated 2 weeks ago
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆80Updated this week
• NVIDIA-AI-Blueprints / rag
  This NVIDIA RAG blueprint serves as a reference solution for a foundational Retrieval Augmented Generation (RAG) pipeline.
  ☆229Updated 2 weeks ago
• run-ai / runai-model-streamer
  ☆238Updated last week
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆96Updated last month
• ibm-granite / granite-3.0-language-models
  ☆262Updated last month
• ibm-granite-community / granite-snack-cookbook
  Granite Snack Cookbook -- easily consumable recipes (python notebooks) that showcase the capabilities of the Granite models
  ☆243Updated last week
• NVIDIA / workbench-example-hybrid-rag
  An NVIDIA AI Workbench example project for Retrieval Augmented Generation (RAG)
  ☆338Updated last week
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆309Updated this week
• triton-inference-server / vllm_backend
  ☆289Updated 2 weeks ago
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆93Updated 3 months ago
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆112Updated 2 months ago
• ray-project / llmperf
  LLMPerf is a library for validating and benchmarking LLMs
  ☆983Updated 8 months ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆349Updated 11 months ago
• data-prep-kit / data-prep-kit
  Open source project for data preparation for GenAI applications
  ☆765Updated this week
• snowflakedb / ArcticInference
  ArcticInference: vLLM plugin for high-throughput, low-latency inference
  ☆210Updated last week
• run-ai / llmperf
  ☆58Updated 11 months ago
• llamastack / llama-stack-client-python
  Python SDK for Llama Stack
  ☆174Updated this week