Alternatives and similar repositories for Instella

Users that are interested in Instella are comparing it to the libraries listed below

• AMD-AGI / AMD-LLM
  ☆189Updated last year
• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS over OpenAI endpoints.
  ☆211Updated this week
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆275Updated 2 months ago
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆117Updated 3 weeks ago
• ibm-granite / granite-4.0-language-models
  ☆53Updated last week
• huawei-csl / SINQ
  Welcome to the official repository of SINQ! A novel, fast and high-quality quantization method designed to make any Large Language Model …
  ☆424Updated this week
• cjpais / LocalScore
  LocalScore is an open benchmark which helps you understand how well your computer can handle local AI tasks.
  ☆60Updated last month
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆181Updated last week
• codelion / pts
  Pivotal Token Search
  ☆126Updated 2 months ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆201Updated last month
• kalavai-net / kalavai-client
  A platform to self-host AI on easy mode
  ☆170Updated this week
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆223Updated last year
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆215Updated 3 months ago
• ScalingIntelligence / tokasaurus
  ☆440Updated last month
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆185Updated 8 months ago
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆296Updated last month
• antimatter15 / reverse-engineering-gemma-3n
  Reverse Engineering Gemma 3n: Google's New Edge-Optimized Language Model
  ☆244Updated 4 months ago
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
  ☆79Updated this week
• pico-lm / pico-analyze
  A companion toolkit to pico-train for quantifying, comparing, and visualizing how language models evolve during training.
  ☆108Updated 6 months ago
• google / lmeval
  ☆232Updated 3 months ago
• Foreseerr / TScale
  ☆196Updated 5 months ago
• bentoml / llm-inference-handbook
  Everything you need to know about LLM inference
  ☆237Updated last week
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆322Updated 11 months ago
• golioth / tinymcp
  Let LLMs control embedded devices via the Model Context Protocol.
  ☆146Updated 3 months ago
• swiss-ai / mmore
  Massive Multimodal Open RAG & Extraction A scalable multimodal pipeline for processing, indexing, and querying multimodal documents Eve…
  ☆141Updated this week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆82Updated last week
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆136Updated this week
• babycommando / neuralgraffiti
  Live-bending a foundation model’s output at neural network level.
  ☆265Updated 6 months ago
• amd / gaia
  Run LLM Agents on Ryzen AI PCs in Minutes
  ☆639Updated last week
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆50Updated 4 months ago