Alternatives and similar repositories for GenAIEval

Users that are interested in GenAIEval are comparing it to the libraries listed below

• opea-project / GenAIComps
  GenAI components at micro-service level; GenAI service composer to create mega-service
  ☆172Updated last week
• opea-project / docs
  This repo contains documents of the OPEA project
  ☆44Updated last month
• opea-project / GenAIExamples
  Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…
  ☆680Updated this week
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆191Updated this week
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆34Updated 6 months ago
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆180Updated 4 months ago
• run-ai / runai-model-streamer
  ☆249Updated this week
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆577Updated this week
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆61Updated this week
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 6 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆132Updated 2 weeks ago
• opea-project / GenAIStudio
  GenAI Studio is a low code platform to enable users to construct, evaluate, and benchmark GenAI applications. The platform also provide c…
  ☆50Updated last month
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆107Updated last week
• vllm-project / speculators
  A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
  ☆45Updated this week
• instructlab / training
  InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data
  ☆42Updated this week
• neuralmagic / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆15Updated this week
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆348Updated last year
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆149Updated last week
• snowflakedb / ArcticInference
  ArcticInference: vLLM plugin for high-throughput, low-latency inference
  ☆239Updated this week
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆72Updated last year
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆266Updated 11 months ago
• substratusai / vllm-docker
  ☆64Updated 5 months ago
• vllm-project / recipes
  Common recipes to run vLLM
  ☆131Updated last week
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆194Updated this week
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆251Updated 7 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆83Updated 2 weeks ago
• pavanjava / llama_workflow_and_agents
  This repository is a combination of llama workflows and agents together which is a powerful concept.
  ☆17Updated last year
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆315Updated last week
• ibm-granite / watsonx-code-assistant-individual
  For individual users, watsonx Code Assistant can access a local IBM Granite model
  ☆35Updated 2 months ago
• NVIDIA-AI-Blueprints / data-flywheel
  ☆86Updated last month