An intelligent load balancer for LM Studio that distributes requests across multiple loaded language models, optimizing resource utilization and response times.
☆21Oct 13, 2025Updated 9 months ago
Alternatives and similar repositories for lm-studio-loadbalancer
Users that are interested in lm-studio-loadbalancer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- mlx-lm server wrapper for agentic harness☆21Jan 26, 2026Updated 6 months ago
- A proxy for minimax-m2, enabling interleaved thinking, and tool calls.☆39Nov 21, 2025Updated 8 months ago
- A modified Codex CLI application built to support local LLMs☆73Nov 24, 2025Updated 8 months ago
- A command-line utility to manage MLX models between your Hugging Face cache and LM Studio.☆88Nov 11, 2025Updated 9 months ago
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆18Apr 11, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- bootstrap my zsh shell☆16Mar 28, 2026Updated 4 months ago
- OpenSource deployment made easy☆10Jun 13, 2015Updated 11 years ago
- ☆13May 13, 2024Updated 2 years ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- Adapter / facade for language models (OpenAI, Anthropic, Cohere, local transformers, etc)☆20Sep 21, 2023Updated 2 years ago
- LM_Chat_TTS_FrontEnd is a simple yet powerful interface for interacting with LM Studio models using text-to-speech functionality. This pr…☆17Feb 11, 2024Updated 2 years ago
- ☆15Jun 13, 2025Updated last year
- Oobabooga Text-Gen Web UI extension: get web content, add to context☆22Jun 1, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- MLX binary vectors and associated algorithms.☆14Mar 13, 2025Updated last year
- A demo of a data science project using Kedro☆17Dec 3, 2021Updated 4 years ago
- Implementation of a fast semantic chunker in C++, installable in python 3.7+ projects.☆22Sep 20, 2025Updated 10 months ago
- 🚥 Quickly set the style of Anybar☆14Jun 17, 2021Updated 5 years ago
- A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX☆61Feb 9, 2024Updated 2 years ago
- Triton‑style kernel toolkit for MLX plus a small upstream incubator: prototype, benchmark, and upstream fusions for Apple Silicon☆48Mar 31, 2026Updated 4 months ago
- MMLU-Pro eval results☆15Aug 21, 2025Updated 11 months ago
- Crop your perfect headshot with AI!☆13Sep 23, 2020Updated 5 years ago
- Python implementation of YiChang Shih's "Style Transfer for Headshots Portraits" [http://www.connellybarnes.com/work/publications/2014_po…☆16Sep 11, 2019Updated 6 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Full Stack AI Mock Interview App with Next.js! 💻 In this tutorial, we'll use React, Drizzle ORM, Gemini AI, and Clerk to create a power…☆34Mar 25, 2025Updated last year
- FastMLX is a high performance production ready API to host MLX models.☆24Nov 18, 2024Updated last year
- A Model Context Protocol server for Scrapybara☆17Mar 18, 2025Updated last year
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆145Apr 15, 2026Updated 3 months ago
- A tool for migrating projects with hard-coded strings to Tolgee JS☆21Nov 14, 2024Updated last year
- A lightweight, easy-to-use Model Context Protocol (MCP) implementation that seamlessly integrates Perplexity's powerful AI models into Cl…☆15Feb 28, 2026Updated 5 months ago
- SDK for the Anthropic API☆16Jun 10, 2026Updated 2 months ago
- Reverse engineering toolkit for Apple Silicon private APIs. 55+ Apple Intelligence models mapped, Metal 4 ML pipeline, 1009 IOReport chan…☆16Mar 26, 2026Updated 4 months ago
- skill.md specialized skill registry for AI agents☆15Apr 24, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The demo is a Hacker News clone and uses RedisJSON for storing the data and RediSearch for searching.☆16Jun 30, 2023Updated 3 years ago
- A Scheduler for Batched LLM Inference☆19Oct 5, 2025Updated 10 months ago
- MLX Model Quantization Toolkit - Comprehensive collection of Jupyter notebooks for converting and quantizing large language models usi…☆16Aug 16, 2025Updated 11 months ago
- Various AI scripts. Mostly Stable Diffusion stuff.☆22Sep 19, 2024Updated last year
- Network monitoring harness for investigating xAI Grok Build CLI data transmission☆15Jul 14, 2026Updated 3 weeks ago
- ☆19Aug 23, 2025Updated 11 months ago
- ☆19Dec 31, 2025Updated 7 months ago