Alternatives and similar repositories for GenAIEval

Users that are interested in GenAIEval are comparing it to the libraries listed below

• opea-project / docs
  This repo contains documents of the OPEA project
  ☆42Updated last week
• opea-project / GenAIComps
  GenAI components at micro-service level; GenAI service composer to create mega-service
  ☆153Updated last week
• opea-project / GenAIInfra
  Containerization and cloud native suite for OPEA
  ☆65Updated this week
• opea-project / GenAIExamples
  Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…
  ☆460Updated this week
• opea-project / GenAIStudio
  GenAI Studio is a low code platform to enable users to construct, evaluate, and benchmark GenAI applications. The platform also provide c…
  ☆43Updated 3 weeks ago
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆33Updated 2 months ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆60Updated 3 weeks ago
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆56Updated last week
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆182Updated this week
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆186Updated this week
• deepset-ai / rag-with-nvidia-nims
  🚀 Use NVIDIA NIMs with Haystack pipelines
  ☆31Updated 9 months ago
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆282Updated this week
• run-ai / runai-model-streamer
  ☆215Updated this week
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆165Updated last month
• monocle2ai / monocle
  Monocle is a framework for tracing GenAI app code. This repo contains implementation of Monocle for GenAI apps written in Python.
  ☆26Updated this week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆127Updated last month
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆317Updated this week
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆89Updated 3 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆114Updated last week
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆243Updated 3 months ago
• ibm-granite-community / granite-code-cookbook
  Granite Code Cookbook
  ☆28Updated last week
• intel / ai-containers
  This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …
  ☆45Updated last week
• langchain-ai / langchain-nvidia
  ☆156Updated last week
• plaggy / rag-containers
  Ready-to-go containerized RAG service. Implemented with text-embedding-inference + Qdrant/LanceDB.
  ☆65Updated 5 months ago
• deepset-ai / haystack-experimental
  🧪 Experimental features for Haystack
  ☆45Updated this week
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆67Updated last month
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆75Updated this week
• intel / Enterprise-RAG
  Intel® AI for Enterprise RAG converts enterprise data into actionable insights with excellent TCO. Utilizing Intel Gaudi AI accelerators …
  ☆16Updated 3 months ago
• cognitivecomputations / kraken
  ☆66Updated last year
• substratusai / vllm-docker
  ☆60Updated 2 months ago