GenAI components at micro-service level; GenAI service composer to create mega-service
☆195Mar 19, 2026Updated this week
Alternatives and similar repositories for GenAIComps
Users that are interested in GenAIComps are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…☆40Jan 5, 2026Updated 2 months ago
- Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…☆727Updated this week
- Containerization and cloud native suite for OPEA☆74Jan 5, 2026Updated 2 months ago
- GenAI Studio is a low code platform to enable users to construct, evaluate, and benchmark GenAI applications. The platform also provide c…☆59Updated this week
- Large Language Model Text Generation Inference on Habana Gaudi☆34Mar 20, 2025Updated last year
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆207Mar 16, 2026Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆85Mar 18, 2026Updated last week
- An innovative library for efficient LLM inference via low-bit quantization☆352Aug 30, 2024Updated last year
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆553Updated this week
- This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …☆64Mar 17, 2026Updated last week
- Exposes Redis stream through the command line☆12Jun 28, 2022Updated 3 years ago
- Intel® AI for Enterprise Inference optimizes AI inference services on Intel hardware using Kubernetes Orchestration. It automates LLM mod…☆38Mar 11, 2026Updated 2 weeks ago
- ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…☆2,178Oct 8, 2024Updated last year
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆65Jun 30, 2025Updated 8 months ago
- ☆24Oct 9, 2025Updated 5 months ago
- Cosmic Tagging Network for Neutrino Physics☆13Jun 26, 2024Updated last year
- Efficient BM25 indexing using rust☆18Sep 17, 2024Updated last year
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …☆2,598Updated this week
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆170Jan 8, 2026Updated 2 months ago
- 🎯An accuracy-first, highly efficient quantization toolkit for LLMs, designed to minimize quality degradation across Weight-Only Quantiza…☆914Updated this week
- Framework for enhancing LLMs for RAG tasks using fine-tuning.☆768Dec 16, 2025Updated 3 months ago
- this is a repository that gives the power of mixture of workflows a concept inspired by the mixture of agents.☆13Aug 19, 2024Updated last year
- We created the Telugu dataset to address the challenge of building Automatic Speech Recognition (ASR) systems for Indian languages, consi…☆21Feb 8, 2024Updated 2 years ago
- A Rust 🦀 client for the fastest graph database on earth!☆21Mar 16, 2026Updated last week
- OpenAI Triton backend for Intel® GPUs☆236Updated this week
- documentation used in my projects☆17Updated this week
- OpenVINO LLM Benchmark☆11Dec 7, 2023Updated 2 years ago
- sapient-freshers-2021-jun-asde☆11Feb 19, 2022Updated 4 years ago
- Multi-Modal Disease Prediction☆14Jun 27, 2024Updated last year
- oneCCL Bindings for Pytorch* (deprecated)☆104Dec 31, 2025Updated 2 months ago
- Pre-built components and code samples to help you build and deploy production-grade AI applications with the OpenVINO™ Toolkit from Intel☆204Updated this week
- Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://dev…☆64Sep 18, 2025Updated 6 months ago
- Intel® Extension for TensorFlow*☆350Oct 29, 2025Updated 4 months ago
- OpenVINO Tokenizers extension☆49Updated this week
- FalkorDB port to Rust☆12Jul 29, 2025Updated 7 months ago
- Notes and artifacts from the ONNX steering committee☆28Mar 11, 2026Updated last week
- Official Repo for SwS: A Weakness-driven Problem Synthesis Framework in RL for LLM Reasoning☆42Nov 11, 2025Updated 4 months ago
- source for llmsec.net☆16Jul 24, 2024Updated last year
- OrcaLoca: An LLM Agent Framework for Software Issue Localization [ICML 25]☆40Apr 7, 2025Updated 11 months ago