compound-ai-systems / awesome-compound-ai-systems

Related projects: ⓘ

• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆95Updated this week
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆86Updated 3 months ago
• ai-hero / llm-research-fine-tuning
  ☆15Updated 3 months ago
• AdrianBZG / LLM-distributed-finetune
  Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …
  ☆50Updated last year
• bentoml / llm-bench
  ☆27Updated last month
• NumbersStationAI / meadow
  Framework for building data agent workflows
  ☆70Updated last month
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆91Updated 2 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆45Updated 5 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆45Updated 3 weeks ago
• run-ai / llmperf
  ☆42Updated this week
• r2e-project / r2e
  ☆77Updated this week
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆52Updated this week
• yale-sys / prompt-cache
  Modular and structured prompt caching for low-latency LLM inference
  ☆43Updated 4 months ago
• LLM360 / Analysis360
  Evaluation and analysis code for LLM360
  ☆75Updated 3 months ago
• jjovalle99 / DSPy-Text2SQL
  DSPY on action with OpenSource LLMs.
  ☆49Updated 5 months ago
• myscale / Retrieval-QA-Benchmark
  Benchmark baseline for retrieval qa applications
  ☆90Updated 5 months ago
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆70Updated last year
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆62Updated this week
• amogkam / batch-inference-benchmarks
  ☆15Updated last year
• anyscale / ray-summit-2023-training
  ☆83Updated 11 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆106Updated 3 months ago
• agiresearch / Formal-LLM
  Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents
  ☆102Updated 3 months ago
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 2 years ago
• ray-project / langchain-ray
  Examples on how to use LangChain and Ray
  ☆217Updated last year
• ray-project / llms-in-prod-workshop-2023
  Deploy and Scale LLM-based applications
  ☆26Updated last year
• IBM / data-prep-kit
  Open source project for data preparation of LLM application builders
  ☆124Updated this week
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆65Updated 3 weeks ago
• davanstrien / data-for-fine-tuning-llms
  ☆71Updated 3 months ago
• qdrant / bm42_eval
  Evaluation of bm42 sparse indexing algorithm
  ☆60Updated 2 months ago
• redis-developer / redis-nvidia-recsys
  Three examples of recommendation system pipelines with NVIDIA Merlin and Redis
  ☆56Updated last year