Benchmark and optimize LLM inference across frameworks with ease
☆174Sep 12, 2025Updated 6 months ago
Alternatives and similar repositories for llm-optimizer
Users that are interested in llm-optimizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆37Nov 14, 2025Updated 4 months ago
- Kubernetes CSI Driver for serving OCI model artifacts☆24Mar 11, 2026Updated 2 weeks ago
- APEX+ is an LLM Serving Simulator☆44Jun 16, 2025Updated 9 months ago
- A Rust reimplementation of genai-bench for benchmarking LLM serving systems at high concurrency with accurate timing and industry-standar…☆279Mar 18, 2026Updated last week
- Legate Hello World Pedagogical Library☆10Apr 5, 2023Updated 2 years ago
- Evals that meet you where you are. For AI that's grounded.☆55Feb 6, 2026Updated last month
- rudradb-opin-examples is for example implementations of the pip install rudradb-opin☆29Mar 3, 2026Updated 3 weeks ago
- Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environments☆48Jan 8, 2026Updated 2 months ago
- ☆56Jul 7, 2025Updated 8 months ago
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆285Updated this week
- ☆11Apr 22, 2025Updated 11 months ago
- Fine-tune FLUX 1.dev for personal AI photos☆22Sep 4, 2024Updated last year
- Baker is an AI powered app that helps you find recipes and avoid food waste☆14Jan 4, 2025Updated last year
- ScrollNet for Continual Learning☆11Sep 11, 2023Updated 2 years ago
- ☆13Oct 9, 2023Updated 2 years ago
- ☆16Apr 28, 2024Updated last year
- ☆28Nov 10, 2025Updated 4 months ago
- Train text generation model with JavaScript.☆15Jul 14, 2024Updated last year
- Evals meant to evaluate language models' ability to reason over long contexts.☆10Sep 12, 2024Updated last year
- Train transformer language models with reinforcement learning.☆19Feb 25, 2025Updated last year
- Generative AI playground using Ollama, OpenAI API and JavaScript. Try AI models in your browser!☆26Updated this week
- 금융 도메인에 특화된 한국어 임베딩 모델☆22Aug 8, 2024Updated last year
- Utility which provides a UI to do prompt engineering within SageMaker Studio.☆14Jul 5, 2023Updated 2 years ago
- ☆60Dec 2, 2024Updated last year
- Official website for the TRON (Token Reduced Object Notation) format☆36Nov 29, 2025Updated 3 months ago
- CMP314 Optimizing NLP models with Amazon EC2 Inf1 instances in Amazon Sagemaker☆14Dec 20, 2023Updated 2 years ago
- This repo contains detailed implementation information about Anthropic's paired prompts approach for evaluating political neutrality.☆120Nov 13, 2025Updated 4 months ago
- Custom launcher for Claude Code, supporting dynamic prompts, layered configuration and easy custom hooks and MCPs.☆16Updated this week
- ☆30Nov 23, 2025Updated 4 months ago
- Linear Relational Embeddings (LREs) and Linear Relational Concepts (LRCs) for LLMs in PyTorch☆10Aug 7, 2024Updated last year
- Enemies for your LLM☆35Jan 20, 2026Updated 2 months ago
- DeepSeek-R1 JavaScript starter☆14Feb 16, 2026Updated last month
- Make reasoning models scalable☆48May 31, 2025Updated 9 months ago
- demo of keyless signing with the sigstore kubernetes policy controller☆11Sep 7, 2022Updated 3 years ago
- Vector databases for generative AI☆22Apr 23, 2024Updated last year
- 🌲 A transport for viewing logs in your favorite browser devtools!☆15Mar 11, 2026Updated last week
- Jina VDR is a multilingual, multi-domain benchmark for visual document retrieval☆38Aug 4, 2025Updated 7 months ago
- Simplified model deployment on llm-d☆28Jul 2, 2025Updated 8 months ago
- A long-horizon, sparse-reward math environment for reinforcement learning. Official code repo for "What makes Math problems hard for rein…☆32Aug 11, 2025Updated 7 months ago