GenAI components at micro-service level; GenAI service composer to create mega-service
☆196Jun 4, 2026Updated last week
Alternatives and similar repositories for GenAIComps
Users that are interested in GenAIComps are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…☆41Apr 6, 2026Updated 2 months ago
- Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…☆735Jun 5, 2026Updated last week
- Containerization and cloud native suite for OPEA☆73Apr 6, 2026Updated 2 months ago
- Large Language Model Text Generation Inference on Habana Gaudi☆34Mar 20, 2025Updated last year
- Source code for Intel's Polite Guard NLP project☆38Dec 15, 2025Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆210Updated this week
- Document Automation Reference Kit☆16Jun 27, 2024Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆88Jun 5, 2026Updated last week
- An innovative library for efficient LLM inference via low-bit quantization☆353Aug 30, 2024Updated last year
- This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …☆78May 27, 2026Updated 2 weeks ago
- ☆59Mar 6, 2026Updated 3 months ago
- Exposes Redis stream through the command line☆12Jun 28, 2022Updated 3 years ago
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆524Updated this week
- With OpenVINO Test Drive, users can run large language models (LLMs) and models trained by Intel Geti on their devices, including AI PCs …☆37Mar 12, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…☆2,178Oct 8, 2024Updated last year
- A repository of Dockerfiles, scripts, yaml files, Helm Charts, etc. used to build and scale the sample AI workflows with python, kubernet…☆12Feb 22, 2024Updated 2 years ago
- Efficient BM25 indexing using rust☆19Sep 17, 2024Updated last year
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …☆2,655Updated this week
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆171Jan 8, 2026Updated 5 months ago
- Framework for enhancing LLMs for RAG tasks using fine-tuning.☆770Updated this week
- this is a repository that gives the power of mixture of workflows a concept inspired by the mixture of agents.☆13Aug 19, 2024Updated last year
- ☆15Dec 12, 2024Updated last year
- OpenVINO LLM Benchmark☆11Dec 7, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Multi-Modal Disease Prediction☆15Jun 27, 2024Updated last year
- This repository contains the results and code for the MLPerf™ Inference v3.1 benchmark.☆11Jul 24, 2025Updated 10 months ago
- Pre-built components and code samples to help you build and deploy production-grade AI applications with the OpenVINO™ Toolkit from Intel☆215Jun 1, 2026Updated last week
- ☆63Dec 18, 2024Updated last year
- Intel® Extension for TensorFlow*☆354Oct 29, 2025Updated 7 months ago
- OpenVINO Tokenizers extension☆52Updated this week
- Jan is an open source alternative to ChatGPT that runs 100% offline on your computer☆12Mar 13, 2026Updated 3 months ago
- Intel® System Health Inspector (aka svr-info) is a Linux command line tool used to assess the health of Intel® Xeon® processor-based serv…☆60Dec 17, 2024Updated last year
- A dashboard for exploring timm learning rate schedulers☆20Nov 22, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- source for llmsec.net☆16Jul 24, 2024Updated last year
- Fork of https://bitbucket.org/nosklo/pysmbclient/src☆13Mar 15, 2019Updated 7 years ago
- A Docker image with Llama Index, Lang Chain, and a few other popular AI packages installed by default☆11Nov 19, 2025Updated 6 months ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆130Sep 23, 2025Updated 8 months ago
- Efficient Retrieval Augmentation and Generation Framework☆1,780Jan 12, 2026Updated 5 months ago
- Awesome Triton Resources☆43Apr 27, 2025Updated last year
- Add real-time Speech-to-Text to your LiveKit application with AssemblyAI☆18Jun 5, 2025Updated last year