[ASPLOS'26] HILOS: A Cost-Effective Near-Storage Processing Solution for Offline Inference of Long-Context LLMs
☆22Jan 18, 2026Updated 10 months ago
Alternatives and similar repositories for HILOS
Users that are interested in HILOS are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [DATE 2023] Pipe-BD: Pipelined Parallel Blockwise Distillation☆11Jul 13, 2023Updated 3 years ago
- [HPCA'24] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System☆52Jul 21, 2025Updated last year
- [PACT'24] GraNNDis. A fast and unified distributed graph neural network (GNN) training framework for both full-batch (full-graph) and min…☆10Aug 13, 2024Updated 2 years ago
- InstAttention: In-Storage Attention Offloading for Cost-Effective Long-Context LLM Inference☆19Mar 30, 2025Updated last year
- RPCNIC: A High-Performance and Reconfigurable PCIe-attached RPC Accelerator [HPCA2025]☆16Dec 9, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Official repository of paper [FALQON: Accelerating LoRA Fine-tuning with Low-Bit Floating-Point Arithmetic, NeurIPS 2025]☆22Dec 2, 2025Updated 11 months ago
- NemoANN: I/O-Efficient Filtered Vector Search on SSDs (SoCC'26)☆16Oct 26, 2026Updated 3 weeks ago
- A High-Throughput Multi-GPU System for Graph-Based Approximate Nearest Neighbor Search☆21Jul 22, 2025Updated last year
- CEMU: Enabling Full-System Emulation of Computational Storage beyond Hardware Limits (ASPLOS'26)☆25Dec 31, 2025Updated 10 months ago
- ☆21Jun 6, 2024Updated 2 years ago
- ☆12Sep 29, 2026Updated last month
- This is the public repo for DREAM accepted to ICS 2025.☆12Dec 28, 2025Updated 10 months ago
- ☆27Nov 29, 2024Updated last year
- KEEP:Official code for "KEEP: A KV-Cache-Centric Memory Management System for Efficient Embodied Planning". A memory management system op…☆13Jul 9, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ECCV 2024] VISAGE: Video Instance Segmentation with Appearance-Guided Enhancement☆39Jul 29, 2024Updated 2 years ago
- ☆13Nov 10, 2026Updated last week
- PPoPP24 AGAThA: Fast and Efficient GPU Acceleration of Guided Sequence Alignment for Long Read Mapping☆22May 8, 2024Updated 2 years ago
- Artifacts of ASPLOS'26 paper titled "FastTTS: Accelerating Test-Time Scaling for Edge LLM Reasoning"☆14Mar 9, 2026Updated 8 months ago
- Learning to Enhance Aperture Phasor Field for Non-Line-of-Sight Imaging☆16Dec 31, 2024Updated last year
- ☆10Mar 3, 2024Updated 2 years ago
- LoCaLUT_AE☆13Dec 8, 2025Updated 11 months ago
- C++17 implementation of einops for libtorch - clear and reliable tensor manipulations with einstein-like notation☆12Oct 16, 2023Updated 3 years ago
- ☆16Jun 17, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A standalone CXL-enabled system simulator.☆22Nov 11, 2026Updated last week
- Qimera: Data-free Quantization with Synthetic Boundary Supporting Samples [NeurIPS 2021]☆35Dec 12, 2021Updated 4 years ago
- ☆19Apr 15, 2025Updated last year
- A GPU cache model for research purposes☆33Nov 4, 2013Updated 13 years ago
- DFVG: A Heterogeneous Architecture for Speculative Decoding with Draft-on-FPGA and Verify-on-GPU.☆29Nov 26, 2025Updated 11 months ago
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆17Dec 19, 2024Updated last year
- Bᴛᴏʀ2MLIR: A Format and Toolchain for Hardware Verification☆20Jul 8, 2026Updated 4 months ago
- NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing☆134Jun 19, 2024Updated 2 years ago
- A new DRAM substrate that mitigates the excessive energy consumption from both (i) transmitting unused data on the memory channel and (i…☆14Aug 23, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official Code for the paper "HieraMamba: Video Temporal Grounding via Hierarchical Anchor-Mamba Pooling"☆19Apr 30, 2026Updated 6 months ago
- ☆16Jun 4, 2024Updated 2 years ago
- ☆16May 16, 2021Updated 5 years ago
- Occamy is a preemptive buffer management for on-chip shared-memory switches☆13Feb 28, 2026Updated 8 months ago
- An FPGA-based full-stack in-storage computing system.☆37Nov 6, 2020Updated 6 years ago
- RobotEvents v2 API Module☆18Jun 8, 2025Updated last year
- High-Throughput, Cost-Effective Billion-Scale Vector Search with a Single GPU [SIGMOD'26]☆33Oct 20, 2026Updated 3 weeks ago
Are these results useful?