Alternatives and similar repositories for Instella

Users that are interested in Instella are comparing it to the libraries listed below

• AMD-AGI / AMD-LLM
  ☆189Updated last year
• ibm-granite / granite-4.0-language-models
  ☆93Updated 3 weeks ago
• swiss-ai / mmore
  Massive Multimodal Open RAG & Extraction A scalable multimodal pipeline for processing, indexing, and querying multimodal documents Eve…
  ☆155Updated this week
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆124Updated last month
• huawei-csl / SINQ
  Welcome to the official repository of SINQ! A novel, fast and high-quality quantization method designed to make any Large Language Model …
  ☆555Updated this week
• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
  ☆226Updated this week
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆201Updated 2 months ago
• codelion / pts
  Pivotal Token Search
  ☆130Updated 3 months ago
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆137Updated this week
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆293Updated 3 months ago
• MiniMax-AI / MiniMax-M2
  MiniMax-M2, a Mini model built for Max coding & agentic workflows.
  ☆656Updated this week
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
  ☆86Updated this week
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆215Updated 4 months ago
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆297Updated 2 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆225Updated last year
• kalavai-net / kalavai-client
  A platform to self-host AI on easy mode
  ☆171Updated last week
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆140Updated 3 months ago
• ScalingIntelligence / tokasaurus
  ☆449Updated this week
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆202Updated last week
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆95Updated 5 months ago
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆264Updated last year
• MetaStone-AI / XBai-o4
  ☆300Updated 2 months ago
• babycommando / neuralgraffiti
  Live-bending a foundation model’s output at neural network level.
  ☆269Updated 6 months ago
• intel / polite-guard
  Source code for Intel's Polite Guard NLP project
  ☆37Updated 2 months ago
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆325Updated last year
• antimatter15 / reverse-engineering-gemma-3n
  Reverse Engineering Gemma 3n: Google's New Edge-Optimized Language Model
  ☆249Updated 5 months ago
• bentoml / llm-inference-handbook
  Everything you need to know about LLM inference
  ☆237Updated this week
• cjpais / LocalScore
  LocalScore is an open benchmark which helps you understand how well your computer can handle local AI tasks.
  ☆65Updated last month
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆81Updated last week
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆185Updated 9 months ago