eth-easl / mixteraLinks
A lightweight, user-friendly data-plane for LLM training.
☆16Updated last month
Alternatives and similar repositories for mixtera
Users that are interested in mixtera are comparing it to the libraries listed below
Sorting:
- An Attention Superoptimizer☆21Updated 4 months ago
- An LLM inference engine, written in C++☆15Updated 4 months ago
- Lightning In-Memory Object Store☆46Updated 3 years ago
- ☆20Updated 2 years ago
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆24Updated 6 months ago
- ML Input Data Processing as a Service. This repository contains the source code for Cachew (built on top of TensorFlow).☆38Updated 8 months ago
- Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".☆20Updated last year
- FractalTensor is a programming framework that introduces a novel approach to organizing data in deep neural networks (DNNs) as a list of …☆25Updated 5 months ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆18Updated 2 years ago
- ☆25Updated 3 months ago
- A resilient distributed training framework☆95Updated last year
- Compression for Foundation Models☆31Updated 2 months ago
- EuroSys '24: "Trinity: A Fast Compressed Multi-attribute Data Store"☆18Updated 2 months ago
- LLM Serving Performance Evaluation Harness☆78Updated 3 months ago
- A curated list for Efficient Large Language Models☆11Updated last year
- ☆12Updated last year
- Vector search with bounded performance.☆35Updated last year
- A collection of reproducible inference engine benchmarks☆31Updated last month
- PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)☆21Updated 11 months ago
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference☆66Updated 5 months ago
- ☆46Updated 11 months ago
- ☆44Updated 3 years ago
- ☆9Updated 10 months ago
- High performance RDMA-based distributed feature collection component for training GNN model on EXTREMELY large graph☆54Updated 2 years ago
- A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.☆25Updated 7 months ago
- ☆35Updated 5 months ago
- Stateful LLM Serving☆70Updated 2 months ago
- ☆17Updated 2 years ago
- [MLSys 2023] Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models☆16Updated 2 years ago