Alternatives and similar repositories for GenAIComps:

Users that are interested in GenAIComps are comparing it to the libraries listed below

• opea-project / GenAIEval
  Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…
  ☆34Updated this week
• opea-project / GenAIExamples
  Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…
  ☆441Updated this week
• opea-project / docs
  This repo contains documents of the OPEA project
  ☆38Updated this week
• opea-project / GenAIInfra
  Containerization and cloud native suite for OPEA
  ☆57Updated this week
• opea-project / GenAIStudio
  GenAI Studio is a low code platform to enable users to construct, evaluate, and benchmark GenAI applications. The platform also provide c…
  ☆38Updated this week
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆33Updated last month
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆269Updated this week
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆159Updated last week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆126Updated last week
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆186Updated this week
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆179Updated this week
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆57Updated 2 weeks ago
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆69Updated this week
• huggingface / optimum-intel
  🤗 Optimum Intel: Accelerate inference with Intel optimization tools
  ☆462Updated this week
• openvinotoolkit / openvino_build_deploy
  Pre-built components and code samples to help you build and deploy production-grade AI applications with the OpenVINO™ Toolkit from Intel
  ☆144Updated this week
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆291Updated this week
• NVIDIA / workbench-example-hybrid-rag
  An NVIDIA AI Workbench example project for Retrieval Augmented Generation (RAG)
  ☆313Updated this week
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆350Updated 8 months ago
• run-ai / llmperf
  ☆53Updated 7 months ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆60Updated this week
• HabanaAI / Setup_and_Install
  Setup and Installation Instructions for Habana binaries, docker image creation
  ☆25Updated 2 months ago
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆43Updated last month
• intel / Enterprise-RAG
  Intel® AI for Enterprise RAG converts enterprise data into actionable insights with excellent TCO. Utilizing Intel Gaudi AI accelerators …
  ☆16Updated 3 months ago
• openvinotoolkit / openvino_tokenizers
  OpenVINO Tokenizers extension
  ☆33Updated this week
• intel / auto-round
  Advanced Quantization Algorithm for LLMs/VLMs.
  ☆454Updated this week
• HabanaAI / Model-References
  Reference models for Intel(R) Gaudi(R) AI Accelerator
  ☆162Updated last week
• run-ai / runai-model-streamer
  ☆207Updated this week
• NVIDIA / workbench-example-mistral-finetune
  An NVIDIA AI Workbench example project for fine-tuning a Mistral 7B model
  ☆55Updated 11 months ago
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆299Updated this week
• triton-inference-server / vllm_backend
  ☆253Updated this week