Alternatives and similar repositories for Block-Attention

Users that are interested in Block-Attention are comparing it to the libraries listed below

• namespace-Pt / UltraGist
  ☆18Updated 6 months ago
• SihengLi99 / SEALONG
  Large Language Models Can Self-Improve in Long-context Reasoning
  ☆70Updated 6 months ago
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆60Updated 5 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆69Updated 3 months ago
• hemingkx / SWIFT
  [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
  ☆49Updated 3 months ago
• dvlab-research / Q-LLM
  This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"
  ☆51Updated 10 months ago
• hkust-nlp / Laser
  Laser: Learn to Reason Efficiently with Adaptive Length-based Reward Shaping
  ☆41Updated 2 weeks ago
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆45Updated 7 months ago
• MileBench / MileBench
  This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
  ☆34Updated 10 months ago
• ShadeCloak / ADORA
  ☆45Updated last month
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆81Updated 3 weeks ago
• hemingkx / TokenSkip
  TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆147Updated 2 months ago
• MingyuJ666 / Disentangling-Memory-and-Reasoning
  [ACL'25] We propose a novel fine-tuning method, Separate Memory and Reasoning, which combines prompt tuning with LoRA.
  ☆54Updated 2 weeks ago
• SalesforceAIResearch / GemFilter
  ☆79Updated 4 months ago
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆56Updated this week
• GAIR-NLP / weak-to-strong-reasoning
  ☆59Updated 9 months ago
• OpenSparseLLMs / LLaMA-MoE-v2
  🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training
  ☆86Updated 6 months ago
• OpenSparseLLMs / MoM
  ☆83Updated last month
• inclusionAI / PromptCoT
  A unified suite for generating elite reasoning problems and training high-performance LLMs, including pioneering attention-free architect…
  ☆51Updated this week
• RyanLiu112 / GenPRM
  Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆73Updated this week
• VITA-Group / Ms-PoE
  "Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiw…
  ☆29Updated last year
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆120Updated 7 months ago
• OpenSparseLLMs / Linear-MoE
  ☆95Updated 2 weeks ago
• DAMO-NLP-SG / LongPO
  [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  ☆37Updated 3 months ago
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆186Updated 3 months ago
• yyDing1 / ScaleQuest
  [ACL-25] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.
  ☆63Updated 7 months ago
• ruipeterpan / specreason
  PoC for "SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning" [arXiv '25]
  ☆37Updated 3 weeks ago
• SihengLi99 / LLM-Honesty-Survey
  A Survey on the Honesty of Large Language Models
  ☆57Updated 5 months ago
• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆50Updated 7 months ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆52Updated 3 months ago