Alternatives and similar repositories for GenAIEval

Users that are interested in GenAIEval are comparing it to the libraries listed below

• opea-project / GenAIComps
  GenAI components at micro-service level; GenAI service composer to create mega-service
  ☆193Updated last week
• opea-project / docs
  This repo contains documents of the OPEA project
  ☆43Updated 3 weeks ago
• opea-project / GenAIExamples
  Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…
  ☆714Updated this week
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆216Updated 2 weeks ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆94Updated 10 months ago
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆199Updated 8 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆163Updated last month
• opea-project / GenAIStudio
  GenAI Studio is a low code platform to enable users to construct, evaluate, and benchmark GenAI applications. The platform also provide c…
  ☆55Updated last month
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆34Updated 9 months ago
• run-ai / runai-model-streamer
  ☆274Updated this week
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆62Updated 4 months ago
• neuralmagic / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆16Updated this week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆131Updated 3 months ago
• deepset-ai / rag-with-nvidia-nims
  🚀 Use NVIDIA NIMs with Haystack pipelines
  ☆32Updated last year
• pavanjava / llama_workflow_and_agents
  This repository is a combination of llama workflows and agents together which is a powerful concept.
  ☆17Updated last year
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated 2 years ago
• substratusai / vllm-docker
  ☆67Updated 9 months ago
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆155Updated 4 months ago
• huggingface / Google-Cloud-Containers
  Hugging Face Deep Learning Containers (DLCs) for Google Cloud
  ☆162Updated last month
• substratusai / helm
  ☆18Updated last year
• cloudera / CML_AMP_RAG_Studio
  ☆18Updated 2 weeks ago
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆117Updated 7 months ago
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆136Updated 3 months ago
• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆91Updated 3 months ago
• NVIDIA / workbench-example-mistral-finetune
  An NVIDIA AI Workbench example project for fine-tuning a Mistral 7B model
  ☆69Updated last year
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆127Updated 3 months ago
• llamastack / llama-stack-client-python
  Python SDK for Llama Stack
  ☆192Updated this week
• tensorwavecloud / ScalarLM
  ScalarLM - a unified training and inference stack
  ☆95Updated 2 months ago
• instructlab / training
  InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data
  ☆44Updated last week
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆161Updated last week