An intelligent load balancer for LM Studio that distributes requests across multiple loaded language models, optimizing resource utilization and response times.
☆21Oct 13, 2025Updated 11 months ago
Alternatives and similar repositories for lm-studio-loadbalancer
Users that are interested in lm-studio-loadbalancer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Patch management tool for git submodules☆19Jul 25, 2025Updated last year
- mlx-lm server wrapper for agentic harness☆21Jan 26, 2026Updated 8 months ago
- This repo maintains a 'cheat sheet' for LLMs that are undertrained on mlx☆33Mar 12, 2026Updated 7 months ago
- A proxy for minimax-m2, enabling interleaved thinking, and tool calls.☆38Nov 21, 2025Updated 10 months ago
- ☆77Nov 22, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆19Apr 11, 2026Updated 6 months ago
- Code for EMNLP 2023 paper: DALE: Generative Data Augmentation for Low-Resource Legal NLP☆11Oct 27, 2023Updated 2 years ago
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- Automatic pitch deck generator for Google Sheets (v0.1)☆11Feb 24, 2023Updated 3 years ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 6 months ago
- OpenSource deployment made easy☆10Jun 13, 2015Updated 11 years ago
- ☆13May 13, 2024Updated 2 years ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.☆11May 26, 2023Updated 3 years ago
- Webb protocol implementation in Substrate.☆37Jun 23, 2023Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Fast & safe Apple Mail search CLI with body content support☆18Sep 19, 2026Updated 3 weeks ago
- LM_Chat_TTS_FrontEnd is a simple yet powerful interface for interacting with LM Studio models using text-to-speech functionality. This pr…☆17Feb 11, 2024Updated 2 years ago
- Oobabooga Text-Gen Web UI extension: get web content, add to context☆22Jun 1, 2024Updated 2 years ago
- A rule based sentence segmentation library.☆14Jul 17, 2023Updated 3 years ago
- MLX binary vectors and associated algorithms.☆14Mar 13, 2025Updated last year
- Example tutorials for twarc v2☆12Jul 30, 2021Updated 5 years ago
- ☆20Apr 8, 2025Updated last year
- A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX☆61Feb 9, 2024Updated 2 years ago
- Some random tools for working with the GGUF file format☆32Nov 24, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The end of Screenshot 2023-12-20-21.11.59.png☆15Dec 22, 2023Updated 2 years ago
- LM Studio plugin for searching the web with DuckDuckGo☆51Jul 4, 2026Updated 3 months ago
- MMLU-Pro eval results☆15Aug 21, 2025Updated last year
- Python implementation of YiChang Shih's "Style Transfer for Headshots Portraits" [http://www.connellybarnes.com/work/publications/2014_po…☆16Sep 11, 2019Updated 7 years ago
- My (current) cursorrules folder☆13Feb 7, 2025Updated last year
- The homepage for ConvSearch Dataset.☆14May 31, 2022Updated 4 years ago
- FastMLX is a high performance production ready API to host MLX models.☆24Nov 18, 2024Updated last year
- EU Regulation Corpus Compiler: A pipeline of Python programs to download EU regulatory documents from the Eur-Lex portal via the CELLAR e…☆19Dec 3, 2021Updated 4 years ago
- Crop your perfect headshot with AI!☆16Sep 23, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆145Apr 15, 2026Updated 5 months ago
- An MLX implementation of Meta AI's ESM-2 protein language model☆16Aug 16, 2025Updated last year
- ☆17Sep 29, 2026Updated last week
- A tool for migrating projects with hard-coded strings to Tolgee JS☆21Nov 14, 2024Updated last year
- The Advanced Interview Responder uses AI to generate tailored responses from a user’s resume and real-time transcribed questions, display…☆12Jan 6, 2025Updated last year
- ☆18May 27, 2025Updated last year
- This repository serves as a collection of scrapers procuring and structuring various legal datasets☆19Jun 16, 2023Updated 3 years ago