DeutscheKI / llm-performance-testsLinks
These are performance benchmarks we did to prepare for our own privacy-preserving and NDA-compliant in-house AI coding assistant. If by any chance, you're a German KMU, and you want strong in-house AI, too, feel free to contact us.
☆24Updated 2 months ago
Alternatives and similar repositories for llm-performance-tests
Users that are interested in llm-performance-tests are comparing it to the libraries listed below
Sorting:
- Transformer GPU VRAM estimator☆64Updated last year
- LLM inference in C/C++☆77Updated 3 weeks ago
- Train Large Language Models on MLX.☆81Updated this week
- Distributed Inference for mlx LLm☆92Updated 10 months ago
- InferX is a Inference Function as a Service Platform☆106Updated this week
- The DPAB-α Benchmark☆24Updated 4 months ago
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Modified to use local Ollama endpoint☆50Updated 7 months ago
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆49Updated 3 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆53Updated 4 months ago
- LLM-as-SERP☆66Updated 3 months ago
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆47Updated 2 weeks ago
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆86Updated this week
- ☆36Updated 4 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆84Updated 5 months ago
- ☆145Updated last month
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆42Updated 9 months ago
- Scripts to create your own moe models using mlx☆89Updated last year
- Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.☆228Updated last week
- ☆90Updated 5 months ago
- ☆358Updated this week
- An intelligent code optimization system leveraging AI analysis, automated refactoring, and test generation. Built with DSPy and Gradio, i…☆19Updated 4 months ago
- Simple examples using Argilla tools to build AI☆53Updated 6 months ago
- Run and manage MCP servers as Docker/Podman containers. Inspired by Docker compose.☆27Updated 3 weeks ago
- Really quick-and-dirty example of AI recursive learning☆26Updated 6 months ago
- Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies a…