Memory-bounded compressed sparse attention via streaming top-k. Triton kernels for the DeepSeek-V4 lightning indexer. 32x regime extension on a single H200 | by RightNow https://www.rightnowai.co/
☆27May 5, 2026Updated 6 months ago
Alternatives and similar repositories for StreamIndex
Users that are interested in StreamIndex are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Single-launch batch-1 decode engine for PrismML Bonsai 27B (ternary and 1-bit) on NVIDIA GPUs. 1.76x the vendor llama.cpp fork on H100, s…☆19Jul 16, 2026Updated 3 months ago
- FlashMemory DS-V4 Retriever: a lightweight retriever that sparsifies DeepSeek-V4 CSA KV-cache. Weights available on Hugging Face.☆111Jul 18, 2026Updated 3 months ago
- Open-source web-based GPU performance visualization tool that transforms NVIDIA profiling data into interactive insights for CUDA enginee…☆13Aug 29, 2025Updated last year
- GLM-5.3-Flash adaptation + offload perf patches for FreeToken v0.1.2 (17.8→36.7 tok/s on one RTX PRO 6000)☆21Oct 2, 2026Updated last month
- ☆28Mar 31, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A custom LSM-tree based storage engine built in Java featuring WAL durability, Memtables, SSTables, Bloom Filters, sparse indexing, and b…☆20Aug 31, 2026Updated 2 months ago
- ☆13Jan 5, 2026Updated 10 months ago
- ☆27Jul 22, 2026Updated 3 months ago
- GEMMs with metal☆27Nov 1, 2026Updated last week
- DialSort implementation in Cpp☆82Jun 15, 2026Updated 4 months ago
- Multi-Word Probabilistic based supertokenizer☆15May 15, 2025Updated last year
- ☆13May 25, 2026Updated 5 months ago
- Automatic detection of flaws in iOS sandbox profiles☆14Jun 13, 2022Updated 4 years ago
- ☆23Dec 7, 2023Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆27Jul 13, 2026Updated 3 months ago
- Hail is a Swift-native foundation for durable, distributed LLM agents—combining virtual actors, event sourcing, durable conversations, st…☆13Updated this week
- QR, symmetric eigendecomposition and SVD for batches of matrices on Apple Silicon GPUs, for MLX and PyTorch. 2x to 10x gain in performanc…☆14Oct 10, 2026Updated last month
- Fetches shared cache symbols for your device☆15Jun 19, 2026Updated 4 months ago
- ☆14Sep 8, 2026Updated 2 months ago
- 基于 CUDA Driver API 的 cuda 运行时环境☆16Jul 30, 2025Updated last year
- Repository for the listwise reranker Rank-K☆16May 23, 2025Updated last year
- LLM inference optimization simulator☆13Jul 12, 2025Updated last year
- ☆49Aug 27, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A Scheduler for Batched LLM Inference☆19Oct 5, 2025Updated last year
- all labs, docs, code for cs240lx, spr 2026☆15Jun 2, 2026Updated 5 months ago
- ☆12Oct 4, 2026Updated last month
- Simple intermediate representation language for learning and research.☆22Mar 27, 2020Updated 6 years ago
- ☆12Jan 5, 2026Updated 10 months ago
- [ECCV 2024] Official Implementation of CoPT: Unsupervised Domain Adaptive Segmentation using Domain-Agnostic Text Embeddings☆10Feb 24, 2025Updated last year
- ☆24Jun 5, 2025Updated last year
- Prompt testing application☆13Jan 21, 2025Updated last year
- A high performance batching router optimises max throughput for text inference workload☆16Sep 6, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A curated list of awesome papers about utilizing large language models for ranking.☆32Apr 12, 2026Updated 7 months ago
- Minimal TPU implementation with 8x8 systolic array and PyTorch integration☆72Jan 26, 2026Updated 9 months ago
- Dynamic Attention Mask (DAM) generate adaptive sparse attention masks per layer and head for Transformer models, enabling long-context in…☆14Jun 16, 2025Updated last year
- Phoenix is a direct hub between storage and xPU — plug in any accelerator (GPU/NPU) or AI app and stream data straight to the chip.☆33Nov 4, 2026Updated last week
- ☆75Nov 22, 2024Updated last year
- Dynamic weight generation for recursive transformers via input-conditioned LoRA modulation☆37Apr 2, 2026Updated 7 months ago
- ☆74Oct 31, 2024Updated 2 years ago
Are these results useful?