Alternatives and similar repositories for Instella

Users that are interested in Instella are comparing it to the libraries listed below

• codelion / pts
  Pivotal Token Search
  ☆124Updated 2 months ago
• AMD-AGI / AMD-LLM
  ☆189Updated last year
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆211Updated this week
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆197Updated last month
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆258Updated 2 months ago
• ScalingIntelligence / tokasaurus
  ☆417Updated 3 weeks ago
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆41Updated last week
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆132Updated 3 months ago
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆291Updated 3 weeks ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆223Updated last year
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆88Updated 4 months ago
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆214Updated 3 months ago
• cjpais / LocalScore
  LocalScore is an open benchmark which helps you understand how well your computer can handle local AI tasks.
  ☆58Updated 2 weeks ago
• MetaStone-AI / XBai-o4
  ☆296Updated last month
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆133Updated this week
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆322Updated 10 months ago
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆110Updated 2 months ago
• NVlabs / Jet-Nemotron
  ☆619Updated 3 weeks ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆185Updated 7 months ago
• pico-lm / pico-analyze
  A companion toolkit to pico-train for quantifying, comparing, and visualizing how language models evolve during training.
  ☆108Updated 5 months ago
• google-ai-edge / LiteRT-LM
  ☆334Updated this week
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆124Updated 6 months ago
• bentoml / llm-inference-handbook
  Everything you need to know about LLM inference
  ☆229Updated last week
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆264Updated 11 months ago
• Foreseerr / TScale
  ☆196Updated 4 months ago
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
  ☆76Updated this week
• google / lmeval
  ☆231Updated 2 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆66Updated last year
• KolosalAI / Kolosal
  Kolosal AI is an OpenSource and Lightweight alternative to LM Studio to run LLMs 100% offline on your device.
  ☆297Updated 3 months ago
• ibm-granite / granite-3.0-language-models
  ☆262Updated 2 months ago