Alternatives and similar repositories for GenAIEval

Users that are interested in GenAIEval are comparing it to the libraries listed below

• opea-project / GenAIComps
  GenAI components at micro-service level; GenAI service composer to create mega-service
  ☆187Updated last week
• opea-project / docs
  This repo contains documents of the OPEA project
  ☆43Updated 3 months ago
• opea-project / GenAIExamples
  Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…
  ☆704Updated this week
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆192Updated 7 months ago
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆216Updated last week
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆34Updated 8 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆130Updated 2 months ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆62Updated 2 months ago
• run-ai / runai-model-streamer
  ☆268Updated last week
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆93Updated 9 months ago
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆137Updated 3 weeks ago
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆201Updated this week
• opea-project / GenAIStudio
  GenAI Studio is a low code platform to enable users to construct, evaluate, and benchmark GenAI applications. The platform also provide c…
  ☆54Updated this week
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆381Updated this week
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆730Updated this week
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆161Updated last week
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆350Updated last year
• ibm-granite-community / granite-retrieval-agent
  Build Research and Rag agents with Granite on your laptop
  ☆149Updated 2 months ago
• instructlab / training
  InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data
  ☆44Updated this week
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆141Updated 2 months ago
• intel / ai-containers
  This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …
  ☆54Updated this week
• micytao / vllm-playground
  ☆120Updated last week
• NVIDIA-AI-Blueprints / data-flywheel
  ☆111Updated 2 weeks ago
• NVIDIA / workbench-example-mistral-finetune
  An NVIDIA AI Workbench example project for fine-tuning a Mistral 7B model
  ☆66Updated last year
• substratusai / helm
  ☆18Updated last year
• ibm-granite-community / granite-snack-cookbook
  Granite Snack Cookbook -- easily consumable recipes (python notebooks) that showcase the capabilities of the Granite models
  ☆320Updated this week
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆130Updated 2 months ago
• langchain-ai / langchain-nvidia
  ☆176Updated this week
• NVIDIA-AI-Blueprints / rag
  This NVIDIA RAG blueprint serves as a reference solution for a foundational Retrieval Augmented Generation (RAG) pipeline.
  ☆385Updated this week
• snowflakedb / ArcticInference
  ArcticInference: vLLM plugin for high-throughput, low-latency inference
  ☆327Updated this week