Alternatives and similar repositories for Block-Attention:

Users that are interested in Block-Attention are comparing it to the libraries listed below

• hemingkx / TokenSkip
  TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆103Updated 2 weeks ago
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆33Updated 9 months ago
• SihengLi99 / SEALONG
  Large Language Models Can Self-Improve in Long-context Reasoning
  ☆67Updated 4 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆56Updated last month
• namespace-Pt / UltraGist
  ☆17Updated 3 months ago
• UNITES-Lab / MC-SMoE
  [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"
  ☆77Updated 9 months ago
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆85Updated 2 weeks ago
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆104Updated last week
• hkust-nlp / mstar
  M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆56Updated 3 months ago
• dvlab-research / Q-LLM
  This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"
  ☆45Updated 8 months ago
• Osilly / dynamic_llava
  [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…
  ☆26Updated 3 months ago
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆81Updated 9 months ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆80Updated 6 months ago
• r-three / smear
  ☆27Updated last year
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆33Updated 6 months ago
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆115Updated 4 months ago
• SUSTechBruce / LOOK-M
  [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…
  ☆92Updated 4 months ago
• SihengLi99 / LLM-Honesty-Survey
  A Survey on the Honesty of Large Language Models
  ☆56Updated 3 months ago
• OpenSparseLLMs / Linear-MoE
  ☆72Updated last week
• MingLiiii / Layer_Gradient
  What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
  ☆63Updated 3 weeks ago
• leezythu / FocusLLM
  FocusLLM: Scaling LLM’s Context by Parallel Decoding
  ☆39Updated 3 months ago
• MileBench / MileBench
  This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
  ☆31Updated 8 months ago
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆158Updated 9 months ago
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆36Updated 11 months ago
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆76Updated last year
• OpenSparseLLMs / MoM
  ☆73Updated last week
• FreedomIntelligence / MLLM-Bench
  MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria
  ☆66Updated 5 months ago
• HKUNLP / critic-rl
  Code for Paper: Teaching Language Models to Critique via Reinforcement Learning
  ☆84Updated last month
• chenllliang / MMEvalPro
  [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs
  ☆23Updated 6 months ago
• SalesforceAIResearch / GemFilter
  ☆76Updated 2 months ago