ArcLight: A Lightweight LLM Inference Framework
☆55May 30, 2026Updated 5 months ago
Alternatives and similar repositories for ArcLight
Users that are interested in ArcLight are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Low-level command-line tool for measuring CPU and Metal GPU memory bandwidth, synthetic LLM decode and prefill memory traffic, cache and …☆21Sep 25, 2026Updated last month
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆25May 12, 2025Updated last year
- ☆19Sep 22, 2026Updated last month
- ☆25Sep 3, 2026Updated last month
- Jev-style decision-model training reproduction on MiniCPM5-2B (stage 1: single-letter Choice classification)☆21Oct 22, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ThinK: Thinner Key Cache by Query-Driven Pruning☆30Jun 2, 2026Updated 4 months ago
- The openJiuwen ecosystem provides an open-source solution for skill hosting and distribution, supporting both self-built and optional Cla…☆32Updated this week
- ☆14Jun 16, 2026Updated 4 months ago
- ☆14Oct 3, 2024Updated 2 years ago
- ☆12Mar 1, 2018Updated 8 years ago
- Build RL environments for LLM training☆28Sep 15, 2026Updated last month
- ☆17Jun 15, 2026Updated 4 months ago
- An Open-Source Knowledge-Enhanced Multilingual Supervised Fine-tuning Dataset☆29Jan 19, 2025Updated last year
- 七夕孤寡助手☆13Aug 7, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A Triton JIT runtime and ffi provider in C++☆41Sep 24, 2026Updated last month
- Revisiting End-to-End Speech-to-Text Translation From Scratch☆13Feb 21, 2023Updated 3 years ago
- 🫧 Code for Holistic Reasoning with Long-Context LMs: A Benchmark for Database Operations on Massive Textual Data (Maekawa*, Iso* et al.…☆13Feb 25, 2025Updated last year
- TPAMI 2025 Survey Paper☆35Mar 31, 2025Updated last year
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆193Jan 28, 2025Updated last year
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated last year
- This repository contains additional reference translations for the WMT'14 En-De (newstest2014) and WMT'19 En-Ru (newstest2019) test sets …☆15Aug 31, 2021Updated 5 years ago
- Tempo is a system for declarative, efficient, end-to-end compiled dynamic deep learning☆31Oct 21, 2025Updated last year
- ☆14Sep 19, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Production-grade ONNX Runtime inference in pure Rust — from YOLO detection and SAM segmentation to Grounding DINO, BiRefNet matting, ArcF…☆23Sep 15, 2026Updated last month
- ☆15Dec 26, 2022Updated 3 years ago
- Scalable toolkit for efficient model reinforcement☆18Jul 28, 2026Updated 3 months ago
- ☆18Sep 27, 2026Updated last month
- WebNN Developer Documentation☆16Updated this week
- CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…☆243Jan 14, 2026Updated 9 months ago
- An open-source AI agent that brings the power of Gemini directly into your terminal.☆10Aug 11, 2025Updated last year
- ☆34Jul 13, 2026Updated 3 months ago
- A minimal implementation of agent skills - a lightweight, open format for extending AI agents with specialized capabilities.☆11Dec 23, 2025Updated 10 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A Dataset for Direct Quotation Extraction and Attribution in News Articles.☆15Sep 28, 2021Updated 5 years ago
- Some CS notes during Jiawei's undergrad.☆33Jan 6, 2022Updated 4 years ago
- ☆34Mar 12, 2026Updated 7 months ago
- Research prototype of PRISM — a cost-efficient multi-LLM serving system with flexible time- and space-based GPU sharing.☆77Mar 17, 2026Updated 7 months ago
- SC 2021, "LogECMem: Coupling Erasure-Coded In-Memory Key-Value Stores with Parity Logging"☆12Jul 12, 2021Updated 5 years ago
- ☆19Aug 9, 2026Updated 2 months ago
- ☆20Jul 15, 2026Updated 3 months ago