Alternatives and similar repositories for SINQ

Users that are interested in SINQ are comparing it to the libraries listed below

• NVlabs / Jet-Nemotron
  ☆712Updated last week
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆215Updated 3 months ago
• leoheuler / flashtensors
  ☆414Updated 3 weeks ago
• LeanModels / DFloat11
  DFloat11: Lossless LLM Compression for Efficient GPU Inference
  ☆569Updated 2 weeks ago
• WeiboAI / VibeThinker
  Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B
  ☆527Updated 3 weeks ago
• MoonshotAI / Kimi-Linear
  ☆1,226Updated 3 weeks ago
• ibm-granite / granite-4.0-language-models
  ☆144Updated last week
• deepreinforce-ai / CUDA-L1
  CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning
  ☆247Updated last month
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆330Updated 4 months ago
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆219Updated 5 months ago
• facebookresearch / cwm
  Research code artifacts for Code World Model (CWM) including inference tools, reproducibility, and documentation.
  ☆751Updated 2 months ago
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆141Updated 2 months ago
• microsoft / wina
  ☆145Updated 4 months ago
• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
  ☆260Updated last week
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆142Updated this week
• MBZUAI-IFM / K2-Think-SFT
  ☆127Updated 3 months ago
• allenai / OLMoASR
  An open-source implementation of Whisper
  ☆466Updated last month
• google-ai-edge / LiteRT-LM
  ☆533Updated this week
• MetaStone-AI / XBai-o4
  ☆301Updated 4 months ago
• intel / auto-round
  Advanced quantization toolkit for LLMs and VLMs. Native support for WOQ, MXFP4, NVFP4, GGUF, Adaptive Schemes and seamless integration wi…
  ☆753Updated this week
• randombk / chatterbox-vllm
  VLLM Port of the Chatterbox TTS model
  ☆342Updated last month
• codelion / ellora
  Enhancing LLMs with LoRA
  ☆191Updated last month
• SakanaAI / natural_niches
  The code repository of the paper: Competition and Attraction Improve Model Fusion
  ☆167Updated 3 months ago
• divagr18 / memlayer
  Plug-and-play memory for LLMs in 3 lines of code. Add persistent, intelligent, human-like memory and recall to any model in minutes.
  ☆217Updated 2 weeks ago
• TesslateAI / TFrameX
  ☆176Updated 4 months ago
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆668Updated 7 months ago
• lemonade-sdk / lemonade
  Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPU…
  ☆1,827Updated this week
• Chen-zexi / vllm-cli
  A command-line interface tool for serving LLM using vLLM.
  ☆454Updated last week
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆125Updated 8 months ago
• Tencent-Hunyuan / Hunyuan-A13B
  Tencent Hunyuan A13B (short as Hunyuan-A13B), an innovative and open-source LLM built on a fine-grained MoE architecture.
  ☆808Updated 5 months ago