Alternatives and similar repositories for llm-scaler

Users that are interested in llm-scaler are comparing it to the libraries listed below

• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆206Updated this week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆73Updated 2 weeks ago
• qrv0 / LLM-Ripper
  LLM Ripper is a framework for component extraction (embeddings, attention heads, FFNs), activation capture, functional analysis, and adap…
  ☆42Updated last week
• intel / intel-ai-assistant-builder
  Intel® AI Assistant Builder
  ☆101Updated this week
• ikiruneo / millionaire-bench
  Benchmark for local LLMs with German "Who Wants to Be a Millionaire" questions.
  ☆34Updated this week
• lhl / strix-halo-testing
  ☆66Updated this week
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆210Updated 2 months ago
• l33tkr3w / LlamaCards
  LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …
  ☆39Updated last year
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆43Updated 3 months ago
• crashr / gppm
  GPU Power and Performance Manager
  ☆61Updated 10 months ago
• amd / fuzzyHSA
  ☆53Updated last year
• codelion / ellora
  Enhancing LLMs with LoRA
  ☆128Updated 3 weeks ago
• ysfemreAlbyrk / ollama-monitor
  Simple system tray application to monitor the status of your LLM models running on Ollama
  ☆21Updated 2 months ago
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆56Updated 6 months ago
• theroyallab / YALS
  ☆83Updated this week
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆42Updated last month
• IanGupta / Kick
  Kick is an AI-powered assistant that provides voice and keyboard control over your Windows device, enabling seamless automation of your d…
  ☆16Updated last month
• hololeo / click-n-ollamarun
  Bookmarklet to pull and run hugging face GGUF models in Ollama
  ☆15Updated 10 months ago
• AmpereComputingAI / llama.cpp
  Ampere optimized llama.cpp
  ☆23Updated this week
• MikeyBeez / Ollama_Agents
  Build an AI Agent from Libraries of Functions -- My most advanced agent framework
  ☆122Updated 2 months ago
• Toy-97 / Chat-WebUI
  Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …
  ☆43Updated last week
• DefamationStation / Retrochat-v2
  RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…
  ☆80Updated last month
• BoredBrownBear / text-generation-webui-model_ducking
  An extension for oobabooga/text-generation-webui that automatically unloads and reloads your model.
  ☆17Updated last year
• wsmlby / homl
  The easiest & fastest way to run LLMs in your home lab
  ☆65Updated last week
• Lanerra / saga
  Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.
  ☆76Updated this week
• NPC-Worldwide / npc-studio
  the IDE for research, built from the ground up with AI integrations
  ☆76Updated this week
• qingy1337 / xplore-terminallm
  Allows two LLMs to communicate and run code in the terminal
  ☆26Updated 8 months ago
• sanctuary-systems-com / llama_multiserver
  A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM
  ☆11Updated 3 months ago
• amd / ryzen-ai-documentation
  Onboarding documentation source for the AMD Ryzen™ AI Software Platform. The AMD Ryzen™ AI Software Platform enables developers to take…
  ☆77Updated 3 weeks ago
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆33Updated 2 weeks ago