A Hybrid LLM Inference Gateway for Local GPUs and Cloud APIs
☆16Oct 25, 2026Updated this week
Alternatives and similar repositories for hybridInference
Users that are interested in hybridInference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a distributed computation platform for running Python and Bash computation tasks on multiple nodes☆12Jul 28, 2026Updated 2 months ago
- RL post-training with your Apple-silicon Macs as the rollout fleet: Mac workers generate experience, GPUs learn, synced over Cloudflare R…☆12Aug 11, 2026Updated 2 months ago
- The first range filter to simultaneously offer dynamicity, fast operations, and a robust false positive rate for any workload.☆13Jul 15, 2025Updated last year
- ☆20Updated this week
- The repository contains a reference end-to-end pipeline for a real-time video analytics application. Realtime data is provided to an infe…☆12Nov 3, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆11May 28, 2025Updated last year
- A performant implementation of the SIEVE caching algorithm that implements Map properties and methods.☆15Apr 1, 2024Updated 2 years ago
- Applications for audio inference at the edge on a raspberry-pi☆13Nov 16, 2021Updated 4 years ago
- A student driven lego detection system☆10Apr 7, 2021Updated 5 years ago
- ☆12Apr 20, 2026Updated 6 months ago
- 本文译自 University of Edinburgh 的 Volker Seeker 的 Process Scheduling in Linux , 介绍了 Linux 3.1 的任务调度机制。☆11Aug 11, 2016Updated 10 years ago
- A collection of category-specific host files☆13Sep 20, 2026Updated last month
- Neovim nightly configurations. Codeberg as backup platform.☆13Updated this week
- In-memory cache implementation with commonly used LRU, W-LFU and S3-FIFO as the eviction policy☆15Apr 24, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Copilot-native integrations for Spec Kit across GitHub Copilot CLI, the Copilot App, and VS Code.☆22Updated this week
- SIEVE in JS, a modern efficient cache algorithm that is simpler than LRU☆17Feb 25, 2024Updated 2 years ago
- About A basic demo example for integrating between Appwrite & Next JS 💙☆18Jun 4, 2022Updated 4 years ago
- SIEVE is simpler than LRU☆15Apr 29, 2024Updated 2 years ago
- [MICRO'20] LENS: A Low-level NVRAM Profiler [USENIX Security'23] NVLeak: Off-Chip Side-Channel Attacks via Non-Volatile Memory Systems☆14Jul 8, 2024Updated 2 years ago
- A tool for inspecting the contents of Apache Traffic Server caches☆14Sep 26, 2019Updated 7 years ago
- Compare NVIDIA Video Codec SDK's, PyAV's, and OpenCV's performance on video decoding.☆13Dec 18, 2022Updated 3 years ago
- Small tool to measure readahead cache performance☆11Sep 28, 2020Updated 6 years ago
- Sphinx is a state-of-the-art succinct and dynamic perfect hash table engineered for high performance on modern x86 CPUs.☆22Aug 31, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Speed up fsspec data access with Alluxio distributed caching.☆18Mar 22, 2026Updated 7 months ago
- Free AI ReCaptcha Solver by Raptor (Captcha Plugin)☆29Oct 2, 2026Updated 3 weeks ago
- Windows Vpn Scripter☆14Dec 7, 2016Updated 9 years ago
- Code for the the article "LLM inference from first principles"☆17May 13, 2025Updated last year
- Heterogeneous memory mapper (hmmap)☆12Dec 4, 2020Updated 5 years ago
- ☆14Jun 13, 2020Updated 6 years ago
- Framework24 - A modern, serverless, framework to launch software products quickly and scale seamlessly☆13Aug 4, 2026Updated 2 months ago
- ☆12Oct 1, 2024Updated 2 years ago
- Mods for Battle Brothers☆12Aug 24, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Stingle API Server☆15Jul 18, 2026Updated 3 months ago
- Alighieri - a lightweight, secure, asynchronous SOCKS5 proxy server with Dante-inspired configuration☆23Updated this week
- Implementation of S3-FIFO cache algorithm☆18Aug 30, 2023Updated 3 years ago
- A fancy NVIDIA GPU monitor for the terminal. One Python file, no dependencies.☆32Updated this week
- Make stochastic AI systems durable with one decorator☆30Apr 1, 2026Updated 6 months ago
- A recommendation application using either item-based or user-based approaches☆13Dec 31, 2023Updated 2 years ago
- Windows Tray Memory is a lightweight yet powerful heavy‑process monitor and RAM cleaner for Windows. It tracks the most memory‑hungry pro…☆19Aug 29, 2026Updated last month