Alternatives and similar repositories for Fairy-plus-minus-i

Users that are interested in Fairy-plus-minus-i are comparing it to the libraries listed below

• moonquest-ai / SRDA
  ☆29Updated 7 months ago
• PKU-SEC-Lab / HybriMoE
  [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"
  ☆96Updated 3 weeks ago
• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆111Updated 3 weeks ago
• PKUFlyingPig / MIT6.5940_TinyML
  Course materials for MIT6.5940: TinyML and Efficient Deep Learning Computing
  ☆65Updated last year
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆96Updated 3 weeks ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆67Updated last year
• infinigence / SpecEE
  Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)
  ☆70Updated 8 months ago
• mdy666 / mdy_triton
  ☆150Updated 6 months ago
• tsinghua-ideal / Twilight
  [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning
  ☆83Updated last month
• attention-survey / Efficient_Attention_Survey
  A Survey of Efficient Attention Methods: Hardware-efficient, Sparse, Compact, and Linear Attention
  ☆270Updated last month
• gogongxt / nano-sglang
  ☆109Updated this week
• ByteDance-Seed / cudaLLM
  ☆126Updated 4 months ago
• dsl-learn / cutile-learn
  NVIDIA cuTile learn
  ☆147Updated last month
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆214Updated 3 months ago
• ifromeast / AI_analysis
  analyse problems of AI with Math and Code
  ☆27Updated 5 months ago
• omni-ai-npu / omni-infer
  Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature se…
  ☆96Updated this week
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆304Updated 7 months ago
• ZRayZzz / flash-attention-v100
  ☆66Updated last year
• stepfun-ai / Step3
  ☆443Updated 5 months ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆144Updated 2 weeks ago
• microsoft / AttentionEngine
  ☆116Updated 7 months ago
• InternLM / Awesome-LLM-Training-System
  ☆45Updated last year
• xlite-dev / ffpa-attn
  🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.
  ☆242Updated last month
• TreeAI-Lab / Awesome-KV-Cache-Management
  This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…
  ☆264Updated last month
• rlite-project / RLite
  A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…
  ☆96Updated 4 months ago
• feifeibear / DPSKV3MFU
  Estimate MFU for DeepSeekV3
  ☆26Updated last year
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆58Updated 4 months ago
• toyaix / triton-runner
  Multi-Level Triton Runner supporting Python, IR, PTX, and cubin.
  ☆81Updated this week
• ByteDance-Seed / FlexPrefill
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆160Updated 2 months ago
• EfficientMoE / MoE-Infinity
  PyTorch library for cost-effective, fast and easy serving of MoE models.
  ☆273Updated 2 months ago