Vortex: A Flexible and Efficient Sparse Attention Framework
☆50Apr 6, 2026Updated this week
Alternatives and similar repositories for vortex_torch
Users that are interested in vortex_torch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Sirius, an efficient correction mechanism, which significantly boosts Contextual Sparsity models on reasoning tasks while maintaining its…☆21Sep 10, 2024Updated last year
- ☆32Jul 2, 2025Updated 9 months ago
- [ICML 2025] LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models☆18Nov 4, 2025Updated 5 months ago
- ☆63Jun 12, 2025Updated 9 months ago
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆44Nov 19, 2025Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [ICML 2025] SparseLoRA: Accelerating LLM Fine-Tuning with Contextual Sparsity☆72Mar 10, 2026Updated 3 weeks ago
- flex-block-attn: an efficient block sparse attention computation library☆128Dec 26, 2025Updated 3 months ago
- Notes for the book Fluent Python, 1st Edition (O'Reilly, 2015)☆11Jun 30, 2022Updated 3 years ago
- ☆38Jul 19, 2025Updated 8 months ago
- ☆65Apr 26, 2025Updated 11 months ago
- Memory optimized Mixture of Experts☆75Jul 25, 2025Updated 8 months ago
- Kinetics: Rethinking Test-Time Scaling Laws☆87Jul 11, 2025Updated 8 months ago
- My tests and experiments with some popular dl frameworks.☆17Sep 11, 2025Updated 6 months ago
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆31Mar 28, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Canvas: End-to-End Kernel Architecture Search in Neural Networks☆27Nov 18, 2024Updated last year
- Tutorial Exercises and Code for GPU Communications Tutorial at HOT Interconnects 2025☆31Oct 22, 2025Updated 5 months ago
- Low overhead tracing library and trace visualizer for pipelined CUDA kernels☆136Nov 26, 2025Updated 4 months ago
- Asynchronous pipeline parallel optimization☆20Feb 2, 2026Updated 2 months ago
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆19Apr 1, 2026Updated last week
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆98Apr 1, 2026Updated last week
- 峰哥亡命天涯视角Skill☆156Updated this week
- helper functions for processing and integrating visual language information with Qwen-VL Series Model☆17Aug 30, 2024Updated last year
- Tile-based language built for AI computation across all scales☆140Mar 27, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆279Aug 31, 2024Updated last year
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆145Dec 4, 2024Updated last year
- Kernels, of the mega variety :)☆699Updated this week
- Learning Descriptor Networks for 3D Shape Synthesis and Analysis☆35Feb 15, 2022Updated 4 years ago
- [AAAI26] LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs☆55Dec 7, 2025Updated 4 months ago
- ☆70Apr 1, 2026Updated last week
- ☆44Oct 15, 2025Updated 5 months ago
- A sparse attention kernel supporting mix sparse patterns☆492Jan 18, 2026Updated 2 months ago
- [ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference☆291May 1, 2025Updated 11 months ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- An Open-Source RAG Workload Trace to Optimize RAG Serving Systems☆36Nov 18, 2025Updated 4 months ago
- ☆14Jul 13, 2025Updated 8 months ago
- [ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache☆381Nov 20, 2025Updated 4 months ago
- hints for xv6lab in installing and doing☆12Jan 28, 2021Updated 5 years ago
- An LLM inference engine, written in C++☆19Mar 30, 2026Updated last week
- Cairo lua bindings with extensions for torch☆15Jun 12, 2016Updated 9 years ago
- [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.☆227May 31, 2025Updated 10 months ago