Alternatives and similar repositories for awesome-compound-ai-systems

Users that are interested in awesome-compound-ai-systems are comparing it to the libraries listed below

• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆153Updated last year
• pyember / ember
  ☆234Updated 5 months ago
• r2e-project / r2e
  [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment
  ☆136Updated 7 months ago
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆114Updated 6 months ago
• AdrianBZG / LLM-distributed-finetune
  Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …
  ☆59Updated 2 years ago
• ScalingIntelligence / codemonkeys
  ☆59Updated 10 months ago
• imagination-research / sot
  [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  ☆182Updated last year
• guestrin-lab / deepscholar-bench
  benchmark and evaluate generative research synthesis
  ☆92Updated last week
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆58Updated last year
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆130Updated 2 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 9 months ago
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆173Updated 7 months ago
• gso-bench / gso
  [NeurIPS '25] Challenging Software Optimization Tasks for Evaluating SWE-Agents
  ☆57Updated last week
• open-lm-engine / lm-engine
  LM engine is a library for pretraining/finetuning LLMs
  ☆77Updated this week
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆265Updated this week
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆107Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆236Updated last year
• aorwall / moatless-tree-search
  ☆126Updated 6 months ago
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆173Updated 7 months ago
• ulab-uiuc / tiny-scientist
  [EMNLP 2025 Demo] TinyScientist: A Lightweight Framework for Building Research Agents
  ☆120Updated last month
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆102Updated 4 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆82Updated 9 months ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆143Updated 8 months ago
• sujitpal / llm-rag-eval
  Large Language Model (LLM) powered evaluator for Retrieval Augmented Generation (RAG) pipelines.
  ☆32Updated last year
• NumbersStationAI / meadow
  Framework for building data agent workflows
  ☆84Updated last year
• OpenPipe / open_deep_research_training
  Training setup for Langchain's Open Deep Research
  ☆72Updated 3 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• GoodAI / goodai-ltm-benchmark
  A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you…
  ☆81Updated 11 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆93Updated 9 months ago
• MooreThreads / TurboRAG
  ☆90Updated last year