Alternatives and similar repositories for SINQ

Users that are interested in SINQ are comparing it to the libraries listed below

• NVlabs / Jet-Nemotron
  ☆695Updated 2 weeks ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆201Updated 2 months ago
• google-ai-edge / LiteRT-LM
  ☆445Updated this week
• LeanModels / DFloat11
  DFloat11: Lossless LLM Compression for Efficient GPU Inference
  ☆554Updated 2 months ago
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆293Updated 3 months ago
• codelion / ellora
  Enhancing LLMs with LoRA
  ☆172Updated last week
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆137Updated this week
• microsoft / wina
  ☆144Updated 2 months ago
• lemonade-sdk / lemonade
  Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPU…
  ☆1,512Updated this week
• iblameandrew / local-deepthink
  It takes a village to raise a child: Google DeepThink 🧠 but in LangGraph and free - an original algorithm for collaborative agents using…
  ☆128Updated last month
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,277Updated this week
• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
  ☆226Updated this week
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆215Updated 4 months ago
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆43Updated this week
• MetaStone-AI / XBai-o4
  ☆300Updated 2 months ago
• ibm-granite / granite-4.0-language-models
  ☆93Updated 3 weeks ago
• Tencent-Hunyuan / Hunyuan-A13B
  Tencent Hunyuan A13B (short as Hunyuan-A13B), an innovative and open-source LLM built on a fine-grained MoE architecture.
  ☆800Updated 3 months ago
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆124Updated last month
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆214Updated last week
• TesslateAI / TFrameX
  ☆168Updated 2 months ago
• facebookresearch / cwm
  Research code artifacts for Code World Model (CWM) including inference tools, reproducibility, and documentation.
  ☆682Updated last month
• deepreinforce-ai / CUDA-L1
  CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning
  ☆195Updated this week
• SakanaAI / treequest
  A Tree Search Library with Flexible API for LLM Inference-Time Scaling
  ☆479Updated last week
• Chen-zexi / vllm-cli
  A command-line interface tool for serving LLM using vLLM.
  ☆433Updated last week
• Chengsong-Huang / R-Zero
  codes for R-Zero: Self-Evolving Reasoning LLM from Zero Data (https://www.arxiv.org/pdf/2508.05004)
  ☆656Updated 3 weeks ago
• MiniMax-AI / MiniMax-M2
  MiniMax-M2, a Mini model built for Max coding & agentic workflows.
  ☆656Updated this week
• kalavai-net / kalavai-client
  A platform to self-host AI on easy mode
  ☆171Updated last week
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆140Updated 3 months ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆541Updated last week
• SakanaAI / natural_niches
  The code repository of the paper: Competition and Attraction Improve Model Fusion
  ☆161Updated 2 months ago