Alternatives and similar repositories for Instella:

Users that are interested in Instella are comparing it to the libraries listed below

• AMD-AIG-AIMA / AMD-LLM
  ☆186Updated 8 months ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆160Updated last week
• amd / gaia
  Run LLM Agents on Ryzen AI PCs in Minutes
  ☆331Updated last month
• moxin-org / Moxin-LLM
  Moxin is a family of fully open-source and reproducible LLMs
  ☆87Updated this week
• LeanModels / DFloat11
  ☆56Updated last week
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆262Updated 7 months ago
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆108Updated 2 months ago
• onnx / turnkeyml
  Local LLM Server with NPU Acceleration
  ☆164Updated this week
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆180Updated this week
• langfuse / oss-llmops-stack
  Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…
  ☆93Updated 2 months ago
• kalavai-net / kalavai-client
  Turns devices into a scalable LLM platform
  ☆128Updated this week
• babycommando / neuralgraffiti
  Live-bending a foundation model’s output at neural network level.
  ☆241Updated 3 weeks ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆179Updated 3 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆200Updated 11 months ago
• containers / podman-desktop-extension-ai-lab
  Work with LLMs on a local environment using containers
  ☆218Updated this week
• Genta-Technology / Kolosal
  Kolosal AI is an OpenSource and Lightweight alternative to LM Studio to run LLMs 100% offline on your device.
  ☆211Updated this week
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆132Updated 2 weeks ago
• lucasjinreal / Crane
  A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.
  ☆100Updated last month
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆88Updated last week
• Vasco0x4 / Neo-AI
  Neo AI integrates into the Linux terminal, capable of executing system commands and providing helpful information.
  ☆103Updated last week
• QuantiusBenignus / blurt
  Gnome shell extension for accurate OFFLINE speech to text input in Linux using whisper.cpp. Input text from speech anywhere.
  ☆75Updated 2 weeks ago
• kyutai-labs / moshivis
  Kyutai with an "eye"
  ☆188Updated last month
• R0bk / killedbyllm
  ☆94Updated 3 months ago
• apple / ml-recurrent-drafter
  ☆208Updated 3 months ago
• Lizonghang / TPI-LLM
  TPI-LLM: Serving 70b-scale LLMs Efficiently on Low-resource Edge Devices
  ☆177Updated 5 months ago
• allenai / OLMoE
  OLMoE: Open Mixture-of-Experts Language Models
  ☆723Updated last month
• bradhilton / temporal-clue
  Clue inspired puzzles for testing LLM deduction abilities
  ☆33Updated last month
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
  ☆38Updated this week
• blackhole89 / autopen
  Editor with LLM generation tree exploration
  ☆66Updated 2 months ago
• eqimp / hogwild_llm
  Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
  ☆94Updated this week