autonomi-ai / nos
⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.
☆129Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for nos
- Vector Database with support for late interaction and token level embeddings.☆54Updated last month
- ☆200Updated 9 months ago
- A library for building software agents using behavior trees and language models.☆74Updated 6 months ago
- ☆108Updated this week
- ☆120Updated this week
- Python client library for improving your LLM app accuracy☆96Updated this week
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆165Updated 2 weeks ago
- Replace expensive LLM calls with finetunes automatically☆62Updated 9 months ago
- Chat Markup Language conversation library☆54Updated 10 months ago
- A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.☆86Updated last week
- A fast batching API to serve LLM models☆172Updated 6 months ago
- A simple DAG for executing LLM calls and using tools.☆39Updated last year
- Verbosity control for AI agents☆59Updated 5 months ago
- Action library for AI Agent☆191Updated 2 weeks ago
- Low-Rank adapter extraction for fine-tuned transformers model☆162Updated 6 months ago
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆134Updated 3 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated 10 months ago
- Solving data for LLMs - Create quality synthetic datasets!☆137Updated last month
- Routing on Random Forest (RoRF)☆84Updated last month
- A toolkit for building multimodal AI agents☆111Updated this week
- Let's create synthetic textbooks together :)☆70Updated 9 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated 6 months ago
- Fast parallel LLM inference for MLX☆149Updated 4 months ago
- Synthetic Data for LLM Fine-Tuning☆97Updated 11 months ago
- Logging and caching superpowers for the openai sdk☆100Updated 8 months ago
- Cerule - A Tiny Mighty Vision Model☆67Updated 2 months ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆74Updated 2 months ago
- 🤖 Headless IDE for AI agents☆133Updated this week
- Start a server from the MLX library.☆161Updated 3 months ago
- Foyle is a copilot to help developers deploy and operate their applications.☆110Updated this week