Alternatives and similar repositories for awesome-compound-ai-systems

Users that are interested in awesome-compound-ai-systems are comparing it to the libraries listed below

• AdrianBZG / LLM-distributed-finetune
  Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …
  ☆59Updated 2 years ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆135Updated last year
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆223Updated last week
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆112Updated 3 months ago
• pyember / ember
  ☆222Updated 2 months ago
• guestrin-lab / deepscholar-bench
  benchmark and evaluate generative research synthesis
  ☆35Updated last week
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• vllm-project / recipes
  Common recipes to run vLLM
  ☆119Updated last week
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆161Updated 4 months ago
• VectorInstitute / fed-rag
  A framework for fine-tuning retrieval-augmented generation (RAG) systems.
  ☆128Updated this week
• NumbersStationAI / meadow
  Framework for building data agent workflows
  ☆82Updated last year
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 6 months ago
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆204Updated last week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆130Updated 3 weeks ago
• anyscale / ray-summit-2023-training
  ☆87Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆226Updated last year
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆58Updated last year
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆182Updated 5 months ago
• ulab-uiuc / tiny-scientist
  A lightweight framework for building research agents designed for developers
  ☆104Updated 2 weeks ago
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated 2 years ago
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆290Updated 3 months ago
• stanford-futuredata / FrugalGPT
  FrugalGPT: better quality and lower cost for LLM applications
  ☆231Updated 6 months ago
• run-ai / llmperf
  ☆58Updated 11 months ago
• multi-agent-systems-failure-taxonomy / MAST
  ☆266Updated last month
• ksm26 / Efficiently-Serving-LLMs
  Learn the ins and outs of efficiently serving Large Language Models (LLMs). Dive into optimization techniques, including KV caching and L…
  ☆17Updated last year
• snowflakedb / ArcticInference
  ArcticInference: vLLM plugin for high-throughput, low-latency inference
  ☆232Updated this week
• apple / ml-superposition-prompting
  ☆145Updated last year
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆82Updated this week
• AgnostiqHQ / multi-agent-llm
  Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)
  ☆120Updated 6 months ago