Alternatives and similar repositories for SINQ

Users that are interested in SINQ are comparing it to the libraries listed below

• microsoft / wina
  ☆145Updated 2 months ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆201Updated last month
• NVlabs / Jet-Nemotron
  ☆674Updated this week
• codelion / ellora
  Enhancing LLMs with LoRA
  ☆159Updated 3 weeks ago
• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS over OpenAI endpoints.
  ☆211Updated this week
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆275Updated 2 months ago
• iblameandrew / local-deepthink
  It takes a village to raise a child: Google DeepThink 🧠 but in LangGraph and free - an original algorithm for collaborative agents using…
  ☆127Updated 2 weeks ago
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆136Updated this week
• iluxu / llmbasedos
  llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work
  ☆279Updated last month
• randombk / chatterbox-vllm
  VLLM Port of the Chatterbox TTS model
  ☆306Updated last month
• evalops / cognitive-dissonance-dspy
  A multi-agent LLM system for detecting and resolving cognitive dissonance.
  ☆267Updated last month
• TesslateAI / TFrameX
  ☆165Updated last month
• MetaStone-AI / XBai-o4
  ☆300Updated 2 months ago
• savantskie / persistent-ai-memory
  A persistent local memory for AI, LLMs, or Copilot in VS Code.
  ☆150Updated last week
• google-ai-edge / LiteRT-LM
  ☆388Updated this week
• devnen / Kitten-TTS-Server
  Self-host the ultra-lightweight Kitten TTS model with this enhanced API server with an intuitive Web UI, large text processing for audiob…
  ☆202Updated 2 months ago
• lemonade-sdk / lemonade
  Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPU…
  ☆1,385Updated this week
• monkesearch / monkeSearch
  fully local, temporally aware natural language file search on your pc! even without a GPU. find relevant files using natural language i…
  ☆120Updated last week
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆42Updated 3 weeks ago
• kalavai-net / kalavai-client
  A platform to self-host AI on easy mode
  ☆171Updated this week
• LeanModels / DFloat11
  DFloat11: Lossless LLM Compression for Efficient GPU Inference
  ☆545Updated last month
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆113Updated 3 weeks ago
• TesslateAI / Agent-Builder
  ☆178Updated last month
• Buddie-AI / Buddie
  BUDDIE is the first full-stack open-source AI voice interaction solution, providing a complete end-to-end system from hardware design to …
  ☆155Updated last month
• universal-tool-calling-protocol / python-utcp
  Official python implementation of UTCP. UTCP is an open standard that lets AI agents call any API directly, without extra middleware.
  ☆573Updated 2 weeks ago
• allenai / OLMoASR
  An open-source implementation of Whisper
  ☆438Updated last week
• conanhujinming / text_dedup
  High-Performance Text Deduplication Toolkit
  ☆57Updated last month
• AMD-AGI / Instella
  Fully Open Language Models with Stellar Performance
  ☆246Updated 2 months ago
• RichardAragon / QGLS
  ☆33Updated 6 months ago
• abhigyanpatwari / GitNexus
  GitNexus is a client-side knowledge graph creator that runs entirely in your browser. Drop in a GitHub repo or ZIP file, and get an inter…
  ☆97Updated this week