High-performance Rust acceleration for LiteLLM - providing significant performance improvements for connection pooling, rate limiting, and memory-intensive workloads.
☆47Aug 30, 2026Updated this week
Alternatives and similar repositories for fast-litellm
Users that are interested in fast-litellm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Recipes for some popular Rust tools☆14Jul 11, 2025Updated last year
- ☆30Jun 13, 2019Updated 7 years ago
- A high-performance AI Gateway written in Rust — call 100+ LLM APIs using OpenAI format☆108Updated this week
- Incident Management Slack Bot☆12Aug 7, 2020Updated 6 years ago
- CLI tool for Amazon ECR☆17Dec 18, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Jenkins X provider for terraform☆14Sep 7, 2020Updated 5 years ago
- A Cloud storage migration command-line tool that uses the scality droplet library☆15Aug 25, 2015Updated 11 years ago
- Demonstrate using MCP with Pydantic AI framework☆14Mar 14, 2025Updated last year
- Techniques that i have used to evade anti-virus during pen tests.☆13May 29, 2018Updated 8 years ago
- Scale to zero Seafowl hosting with Cloud Run☆37Jun 6, 2023Updated 3 years ago
- Cloudflare Workers I run, with assorted purposes☆12Aug 22, 2026Updated last week
- 🗿Stones: Persistent key-value containers, compatible with Python dict☆17Jul 15, 2024Updated 2 years ago
- Jupyter notebooks for cloud-based usage☆10Aug 26, 2023Updated 3 years ago
- Python DSL that compiles element-wise expressions to parallel Rust. All CPU cores, zero serialization.☆44Mar 19, 2026Updated 5 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A Rust implementation of a constant time LFU cache☆14Jun 23, 2026Updated 2 months ago
- A template for Python projects that need to use a relational database, including tooling for managing schema migrations and testing again…☆13Dec 13, 2024Updated last year
- Syna is a lightweight machine learning framework inspired by DeZero.☆16Oct 26, 2025Updated 10 months ago
- Prebuilt Terraform CDK (cdktf) provider for cloudflare.☆15Dec 10, 2025Updated 8 months ago
- ☆10May 27, 2025Updated last year
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆149Jul 28, 2026Updated last month
- Add shortcuts for Logseq task management☆12Jul 4, 2023Updated 3 years ago
- API client for fetching and comparing passages from legislation☆14Jun 29, 2026Updated 2 months ago
- Refined Direct Preference Optimization with Synthetic Data for Behavioral Alignment of LLMs☆13Feb 13, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Digital Innovation Festival React Typescript workshop☆10Jan 6, 2023Updated 3 years ago
- Python client SDK for the Qumulator quantum computing API☆20Jul 26, 2026Updated last month
- ☆103Jun 20, 2026Updated 2 months ago
- Trained BERT and Word2Vec legal clause classifiers for SPACY using the Atticus Project's Open Source Contract Label Corpus☆14Jan 2, 2021Updated 5 years ago
- ☆16Sep 23, 2023Updated 2 years ago
- Demos for AI assistants using NLUX, Next.js, React, and Node.js☆17Jun 24, 2024Updated 2 years ago
- A notebook showing how to easily convert a current notebook you have to a notebook that can be run on Kubeflow Pipelines.☆15Jul 15, 2020Updated 6 years ago
- rust coroutine database driver (Mysql,Postgres,Sqlite,Mssql)☆14Dec 8, 2023Updated 2 years ago
- Curadoria dos melhores links compartilhados no grupo https://t.me/nlpbr no Telegram.☆12Apr 10, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆33May 16, 2026Updated 3 months ago
- Over-Engineered personal bot. Build with maximum scalability, development speed and integration between all possible platforms in mind.☆11Apr 8, 2026Updated 4 months ago
- SmallDB - a relational database that support various latch modes, storage modes and transaction isolation levels.☆24May 17, 2026Updated 3 months ago
- Proof of concept for running moshi/hibiki using webrtc☆21Feb 28, 2025Updated last year
- Reasoning model integration for pydantic-ai's agent☆15Oct 13, 2025Updated 10 months ago
- Standard Notes standalone infrastructure for the Raspberry Pi☆20Sep 12, 2021Updated 4 years ago
- Open Source Wordpress chat bot plugin for wordpress. (UI in developmennt, Help wanted).☆18Feb 15, 2025Updated last year