Implementation of "FlashPreill: Instantaneous Pattern Discovery and Thresholding for Ultra-Fast Long-Context Prefilling"
☆57Apr 27, 2026Updated 6 months ago
Alternatives and similar repositories for FlashPrefill
Users that are interested in FlashPrefill are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS2026]"UniPrefill: Universal Long-Context Prefill Acceleration via Block-wise Dynamic Sparsification"☆47Sep 26, 2026Updated last month
- Elastic Attention: Test-time Adaptive Sparsity Ratios for Efficient Transformers☆24May 26, 2026Updated 5 months ago
- FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM Serving☆33Aug 28, 2026Updated 2 months ago
- [ACL 2025 Main] (🏆 Outstanding Paper Award) Rethinking the Role of Prompting Strategies in LLM Test-Time Scaling: A Perspective of Proba…☆20Aug 15, 2025Updated last year
- Implementation of the paper "ProxyAttn: Guided Sparse Attention via Representative Heads".☆14Mar 9, 2026Updated 8 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference☆172Oct 13, 2025Updated last year
- PyTorch Implementation of LocAtViT in "Locality-Attending Vision Transformer" (ICLR 2026)☆20Aug 12, 2026Updated 3 months ago
- [NeurIPS 2026 Pre-to-Post] From P(y|x) to P(y): Investigating Reinforcement Learning in Pre-train Space☆20Apr 16, 2026Updated 6 months ago
- ☆36Dec 10, 2025Updated 11 months ago
- ☆20Nov 22, 2025Updated 11 months ago
- [ICML 2026] Sparser Block-Sparse Attention via Token Permutation☆33May 22, 2026Updated 5 months ago
- [ICCV2025 highlight]Rectifying Magnitude Neglect in Linear Attention☆65Jul 24, 2025Updated last year
- High Performance LLM Inference Operator Library☆1,190Updated this week
- Revealing and unlocking the context boundary of reward models☆21May 10, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆104Feb 11, 2026Updated 9 months ago
- FlowPrefill: Decoupling Preemption from Prefill Scheduling Granularity to Mitigate Head-of-Line Blocking in LLM Serving☆12Aug 3, 2026Updated 3 months ago
- ☆31Jan 20, 2026Updated 9 months ago
- 🏝️ Code for our paper: "Privasis: Synthesizing the Largest 'Public' Private Dataset from Scratch"☆16Jul 10, 2026Updated 4 months ago
- ☆68May 19, 2025Updated last year
- ☆16Jun 17, 2026Updated 4 months ago
- ☆24Jun 5, 2025Updated last year
- SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs☆224Jul 10, 2026Updated 4 months ago
- ☆255Nov 19, 2025Updated 11 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Visualize the Expert Parallelism Load Balancer☆19Mar 15, 2025Updated last year
- Comparative study and experimentation on standard vs mHC vs attention residual (full and block)☆13Mar 17, 2026Updated 7 months ago
- [ICLR 2026] This is the official PyTorch implementation of "QVGen: Pushing the Limit of Quantized Video Generative Models".☆34Feb 11, 2026Updated 9 months ago
- ☆16Nov 11, 2025Updated last year
- Official implementation for the paper "Video-Based Reward Modeling for Computer-Use Agents"☆18Mar 14, 2026Updated 8 months ago
- [TCAD 2021] Block Convolution: Towards Memory-Efficient Inference of Large-Scale CNNs on FPGA☆17Jul 7, 2022Updated 4 years ago
- 🧂 [ECCV 2026] Salt: Self-Consistent Distribution Matching with Cache-Aware Training for Fast Video Generation☆26Aug 24, 2026Updated 2 months ago
- Official Implementation of APB (ACL 2025 main Oral) and Spava (ACL 2026 main).☆37Apr 6, 2026Updated 7 months ago
- code for paper Accurate KV Cache Quantization with Outlier Tokens Tracing (ACL2025 Main)☆11Jul 4, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [CVPR-26] Official repository of "CaTok: Taming Mean Flows for One-Dimensional Causal Image Tokenization"☆20Mar 9, 2026Updated 8 months ago
- OccuBench: Evaluating AI Agents on Real-World Professional Tasks via Language World Models☆22Apr 14, 2026Updated 7 months ago
- This is the codes of "DARE: Aligning LLM Agents with the R Statistical Ecosystem via Distribution-Aware Retrieval"☆15Aug 11, 2026Updated 3 months ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆102Sep 4, 2024Updated 2 years ago
- [🏆ECCV'26] Official Repo for SlowBA: An efficiency backdoor attack towards VLM-based GUI agents☆20Updated this week
- ☆18Mar 16, 2026Updated 7 months ago
- A fault-tolerant RDMA-based disaggregated key-value store with 1-RTT UPDATEs and GETs thanks to the SWARM replication protocol☆14Sep 25, 2024Updated 2 years ago
Are these results useful?