🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
☆138Jul 25, 2024Updated last year
Alternatives and similar repositories for benchmarks
Users that are interested in benchmarks are comparing it to the libraries listed below
Sorting:
- an auto-sleeping and -waking framework around llama.cpp☆12Feb 8, 2025Updated last year
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆59Jan 5, 2026Updated last month
- Exploring limitations of LLM-as-a-judge☆20Aug 17, 2024Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆267Dec 4, 2025Updated 2 months ago
- This project showcases engaging interactions between two AI chatbots.☆10Jan 10, 2024Updated 2 years ago
- Proxy server for triton gRPC server that inferences embedding model in Rust☆21Aug 10, 2024Updated last year
- ☆12Jan 19, 2024Updated 2 years ago
- REBUS: A Robust Evaluation Benchmark of Understanding Symbols☆13Aug 13, 2024Updated last year
- AI_Powered_Dev_Search_Engine☆12Mar 10, 2024Updated last year
- Identify and automatically fix issues in shell scripts☆15Nov 24, 2023Updated 2 years ago
- B-Llama3o a llama3 with Vision Audio and Audio understanding as well as text and Audio and Animation Data output.☆26Jun 3, 2024Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆84Oct 29, 2024Updated last year
- Attend - to what matters.☆17Feb 22, 2025Updated last year
- Benchmark scripts for comparing different tokenizers and sentence segmenters of German☆12Feb 27, 2023Updated 3 years ago
- WebAISum is a Python script that allows you to summarize web pages using AI models. It supports both local models like Ollama and remote …☆15Apr 28, 2024Updated last year
- Docker images for Stable Diffusion WebUI (AUTOMATIC1111) for AMD Radeon RX5500XT and similar boards☆13Oct 15, 2024Updated last year
- Learning and rediscovering ML from total scratch☆12Aug 30, 2021Updated 4 years ago
- Running Microsoft's BitNet inference framework via FastAPI, Uvicorn and Docker.☆36Jul 2, 2025Updated 8 months ago
- Small tools to enhance your AI app with little effort.☆12Jan 9, 2024Updated 2 years ago
- When real time Yoga Position classification meets GNN☆11Sep 17, 2023Updated 2 years ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Jun 7, 2024Updated last year
- This repository contains the metadata and data of different databases that we use for testing☆14Jan 29, 2025Updated last year
- Quantized inference code for LLaMA models☆13Mar 12, 2023Updated 2 years ago
- A guidance compatibility layer for llama-cpp-python☆36Sep 11, 2023Updated 2 years ago
- 33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU☆13May 5, 2024Updated last year
- Python library for automatic training, optimization and comparison of Transformer models on most NLP tasks.☆20May 6, 2023Updated 2 years ago
- Implementation of various Machine learning and MLOps applications/tutorials used within my Medium blog.☆11Jan 28, 2023Updated 3 years ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Jan 29, 2024Updated 2 years ago
- Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies a…☆39Apr 10, 2025Updated 10 months ago
- Benchmark Large Language Models Reliably On Your Data☆18Dec 27, 2025Updated 2 months ago
- 🤖 AI Assistant fine-tuned to provide support for coding and design questions based on the latest trends in the industry.☆17Jan 14, 2024Updated 2 years ago
- Fast-track AI apps to production with LLaMA 3, Mistral, and other top LLMs!☆21Jul 12, 2024Updated last year
- TLS & API keys for your LLM APIs☆20Dec 17, 2025Updated 2 months ago
- This repository contains the source code for running llamaindex tutorials from https://howaibuildthis.substack.com/☆41Jan 7, 2024Updated 2 years ago
- 3x Faster Inference; Unofficial implementation of EAGLE Speculative Decoding☆83Jul 3, 2025Updated 7 months ago
- A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks☆39Jun 10, 2024Updated last year
- An integration of Qdrant ANN vector database backend with Haystack☆46Jan 5, 2026Updated last month
- Running Microsoft's BitNet via Electron, React & Astro☆53Sep 26, 2025Updated 5 months ago
- Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…☆42Sep 26, 2024Updated last year