compound-ai-systems / awesome-compound-ai-systemsLinks
A curated list of awesome Compound AI Systems
☆35Updated 7 months ago
Alternatives and similar repositories for awesome-compound-ai-systems
Users that are interested in awesome-compound-ai-systems are comparing it to the libraries listed below
Sorting:
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆131Updated 4 months ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆153Updated last year
- Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …☆60Updated 2 years ago
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆139Updated last week
- A collection of all available inference solutions for the LLMs☆94Updated 11 months ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆282Updated this week
- ☆237Updated 3 weeks ago
- Fine-tune an LLM to perform batch inference and online serving.☆117Updated 8 months ago
- Training setup for Langchain's Open Deep Research☆74Updated 5 months ago
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation☆184Updated last year
- ☆61Updated last year
- Framework for building data agent workflows☆84Updated last year
- ☆80Updated last year
- AI-Driven Research Systems (ADRS)☆117Updated last month
- LM engine is a library for pretraining/finetuning LLMs☆113Updated this week
- LLM Serving Performance Evaluation Harness☆83Updated 11 months ago
- Benchmark suite for LLMs from Fireworks.ai☆86Updated 2 weeks ago
- AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)☆80Updated last year
- FrugalGPT: better quality and lower cost for LLM applications☆246Updated 11 months ago
- Tutorial to get started with SkyPilot!☆58Updated last year
- ☆43Updated last year
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆379Updated last week
- Tutorial for building LLM router☆242Updated last year
- This repository contains a pipeline for fine-tuning Large Language Models (LLMs) for Text-to-SQL conversion using General Reward Proximal…☆44Updated 9 months ago
- IBM development fork of https://github.com/huggingface/text-generation-inference☆63Updated 4 months ago
- ☆89Updated 2 years ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆272Updated this week
- build and benchmark deep research☆211Updated this week
- A list of LLM benchmark frameworks.☆73Updated last year