SakanaAI / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
☆25Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for vllm
- Official homepage for "Self-Harmonized Chain of Thought"☆83Updated 2 months ago
- ☆54Updated 10 months ago
- The next evolution of Agents☆46Updated last week
- ☆112Updated this week
- Beating the GAIA benchmark with Transformers Agents. 🚀☆62Updated 3 weeks ago
- Using multiple LLMs for ensemble Forecasting☆16Updated 10 months ago
- Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.☆27Updated this week
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆64Updated this week
- Minimal, clean code implementation of RAG with mlx using gguf model weights☆43Updated 6 months ago
- CAMEL framework-based multi-agent system for task-driven and dynamic environments☆72Updated 6 months ago
- Q-Star Agent Code: A reinforcement learning-based framework for intelligent agents using Microsoft AutoGen. It leverages Q-Star, a Q-lear…☆65Updated 9 months ago
- LLM reads a paper and produce a working prototype☆36Updated last week
- ☆16Updated last month
- A desktop for AI agents☆28Updated this week
- Testing the different LLM and RAG Tests while I learn along the way☆17Updated 2 months ago
- A vast array of examples for the enterprise-grade and production-ready swarms framework.☆26Updated this week
- ☆40Updated last month
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆32Updated 6 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆50Updated 11 months ago
- RAG example using DSPy, Gradio, FastAPI☆66Updated 7 months ago
- All the world is a play, we are but actors in it.☆47Updated 4 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 6 months ago
- A repository of projects and datasets under active development by Alignment Lab AI☆22Updated 11 months ago
- Simple Implementation of a Transformer in the new framework MLX by Apple☆21Updated this week
- ☆104Updated 8 months ago
- 🍲Agent Chef🥘 is my robust tool for dataset refinement, structuring, and generation. By leveraging procedural and synthetic dataset gene…☆16Updated this week
- Gradio based tool to run opensource LLM models directly from Huggingface☆87Updated 4 months ago
- Function Calling Mistral 7B. Learn how to make functions call for open source LLMs.☆48Updated 9 months ago
- A toolkit for building multimodal AI agents☆111Updated this week
- ☆28Updated 8 months ago