compound-ai-systems / awesome-compound-ai-systems

Related projects ⓘ

Alternatives and complementary repositories for awesome-compound-ai-systems

• AdrianBZG / LLM-distributed-finetune
  Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …
  ☆53Updated last year
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆103Updated last week
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆93Updated 5 months ago
• redis-developer / redis-nvidia-recsys
  Three examples of recommendation system pipelines with NVIDIA Merlin and Redis
  ☆57Updated last year
• kevinwu23 / StanfordFineTuneBench
  ☆22Updated last week
• run-ai / llmperf
  ☆47Updated 2 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆59Updated 2 weeks ago
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆56Updated 6 months ago
• yale-sys / prompt-cache
  Modular and structured prompt caching for low-latency LLM inference
  ☆69Updated 2 weeks ago
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆77Updated 2 weeks ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆57Updated last month
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆97Updated 4 months ago
• skypilot-org / skypilot-catalog
  ☆20Updated this week
• tyler-griggs / melange-release
  ☆38Updated 4 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆57Updated 2 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆74Updated last week
• abacusai / gh200-llm
  Packages and instructions for training and inference of LLMs on NVIDIA's new GH200 machines
  ☆19Updated 2 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆73Updated 2 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆29Updated 4 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 4 months ago
• NumbersStationAI / meadow
  Framework for building data agent workflows
  ☆81Updated 3 months ago
• JiahaoYao / awesome-ray
  Ray - A curated list of resources: https://github.com/ray-project/ray
  ☆42Updated last year
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated last year
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆47Updated 10 months ago
• MooreThreads / TurboRAG
  ☆34Updated this week
• google / space
  Unified storage framework for the entire machine learning lifecycle
  ☆149Updated 8 months ago
• bentoml / llm-bench
  ☆36Updated this week
• ScalingIntelligence / hydragen
  Hydragen: High-Throughput LLM Inference with Shared Prefixes
  ☆24Updated 6 months ago
• SalesforceAIResearch / SFR-RAG
  ☆65Updated last month
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆30Updated 3 months ago