Alternatives and similar repositories for GenAIComps:

Users that are interested in GenAIComps are comparing it to the libraries listed below

• opea-project / GenAIExamples
  Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…
  ☆382Updated this week
• opea-project / docs
  This repo contains documents of the OPEA project
  ☆30Updated this week
• opea-project / GenAIEval
  Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…
  ☆28Updated this week
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆33Updated this week
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆173Updated last week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆120Updated 2 weeks ago
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆227Updated this week
• opea-project / GenAIStudio
  GenAI Studio is a low code platform to enable users to construct, evaluate, and benchmark GenAI applications. The platform also provide c…
  ☆33Updated 3 weeks ago
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆151Updated last week
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆58Updated this week
• triton-inference-server / vllm_backend
  ☆235Updated this week
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆351Updated 6 months ago
• meta-llama / llama-stack-client-python
  Python SDK for Llama Stack
  ☆133Updated this week
• run-ai / llmperf
  ☆54Updated 5 months ago
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆175Updated this week
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆60Updated 2 months ago
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆103Updated 8 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆186Updated 7 months ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆61Updated last week
• intel / certified-developer
  Official repository of the Intel Certified Developer Program
  ☆45Updated this week
• ibm-granite-community / granite-snack-cookbook
  Granite Snack Cookbook -- easily consumable recipes (python notebooks) that showcase the capabilities of the Granite models
  ☆153Updated this week
• huggingface / optimum-intel
  🤗 Optimum Intel: Accelerate inference with Intel optimization tools
  ☆447Updated this week
• NVIDIA / workbench-example-mistral-finetune
  An NVIDIA AI Workbench example project for fine-tuning a Mistral 7B model
  ☆53Updated 9 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆92Updated this week
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆289Updated last month
• huggingface / Google-Cloud-Containers
  Hugging Face Deep Learning Containers (DLCs) for Google Cloud
  ☆141Updated last month
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆80Updated last week
• NVIDIA / workbench-example-hybrid-rag
  An NVIDIA AI Workbench example project for Retrieval Augmented Generation (RAG)
  ☆306Updated 3 months ago
• intel / Enterprise-RAG
  Intel® AI for Enterprise RAG converts enterprise data into actionable insights with excellent TCO. Utilizing Intel Gaudi AI accelerators …
  ☆15Updated last month