Alternatives and similar repositories for Aule-Attention

Users that are interested in Aule-Attention are comparing it to the libraries listed below

• reka-ai / rekaquant
  ☆62Updated 6 months ago
• IST-DASLab / gptq-gguf-toolkit
  Efficient non-uniform quantization with GPTQ for GGUF
  ☆57Updated 4 months ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆217Updated 5 months ago
• fal-ai / flashpack
  High-throughput tensor loading for PyTorch
  ☆219Updated last month
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆87Updated this week
• ritabratamaiti / AnyModal
  AnyModal is a Flexible Multimodal Language Model Framework for PyTorch
  ☆103Updated last year
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆106Updated 7 months ago
• Liquid4All / liquid-audio
  Liquid Audio - Speech-to-Speech audio models by Liquid AI
  ☆356Updated last week
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆146Updated this week
• fidecastro / llama-cpp-connector
  Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!
  ☆29Updated last month
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆42Updated 2 months ago
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆47Updated 2 months ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 6 months ago
• QuixiAI / dolphin-utils
  ☆15Updated last month
• Thireus / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆44Updated this week
• kyutai-labs / moshivis
  Kyutai with an "eye"
  ☆233Updated 9 months ago
• KohakuBlueleaf / KohakuHub
  A self-hosted HuggingFace alternative
  ☆151Updated 2 months ago
• Dicklesworthstone / llm-tournament
  Automated LLM Coding Tournaments. There can be only one (winning code solution from the competing AIs)
  ☆44Updated 9 months ago
• Cornell-RelaxML / yaqa-quantization
  ☆69Updated 6 months ago
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆50Updated 7 months ago
• AlexBodner / How_Much_VRAM
  ☆101Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆99Updated 6 months ago
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆59Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆220Updated 3 weeks ago
• electroglyph / quant_clone
  Generate a llama-quantize command to copy the quantization parameters of any GGUF
  ☆29Updated 5 months ago
• julien-blanchon / Montelimar
  Montelimar - Extract text from anywhere
  ☆87Updated 3 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆100Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 2 months ago
• fal-ai-community / llmdifftracker
  Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)
  ☆34Updated 10 months ago
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆155Updated 8 months ago