Yet Another LLM Inference System
☆18Mar 1, 2026Updated 7 months ago
Alternatives and similar repositories for yalis
Users that are interested in yalis are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11May 15, 2024Updated 2 years ago
- The fastest off-the-shelf inference algorithm for LLMs (ICLR’25)☆14Mar 8, 2025Updated last year
- Algorithms for approximate attention in LLMs☆23Apr 14, 2025Updated last year
- ☆17Feb 3, 2023Updated 3 years ago
- ☆18Oct 14, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Sequence-level 1F1B schedule for LLMs.☆19Jun 4, 2024Updated 2 years ago
- Distributed Deep Learning Tutorial☆21Mar 10, 2026Updated 7 months ago
- This repository is the official implementation of "Jakiro: Boosting Speculative Decoding with Decoupled Multi-Head via MoE" [ACL 2026 Mai…☆39Oct 5, 2025Updated last year
- Converts an Infiniband topology file to graphviz dot format or slurm topology.conf format☆18Feb 2, 2026Updated 8 months ago
- Official project website for the AAAI 2022 paper "Stereo Neural Vernier Caliper"☆17Feb 26, 2023Updated 3 years ago
- Simply log all kernel durations☆18Aug 26, 2026Updated last month
- ☆19Sep 10, 2026Updated last month
- [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"☆126Dec 15, 2025Updated 10 months ago
- Benchmarking the accelerated generation quality of OneDiff.☆13Oct 21, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- code for 3D object detector MLOD☆23Feb 5, 2026Updated 8 months ago
- 吴恩达深度学习课程笔记PyTorch版☆21Nov 2, 2025Updated 11 months ago
- 利用github actions跟踪一些仓库的每日更新☆22Updated this week
- ☆32Oct 18, 2020Updated 6 years ago
- [ICLR 2026] SERE: Similarity-Based Expert Re-routing for Efficient Batch Decoding in MoE Models☆23Feb 4, 2026Updated 8 months ago
- Distributed IO-aware Attention algorithm☆24Sep 24, 2025Updated last year
- ☆25Apr 4, 2026Updated 6 months ago
- ☆19Sep 26, 2026Updated 3 weeks ago
- Auto-detect AMD GPUs on Windows/Linux and instantly get the correct HSA_OVERRIDE_GFX_VERSION for local AI (ROCm/HIP).☆17Sep 23, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Zotero completion source for nvim-cmp using zotcite as backend.☆25Oct 23, 2025Updated last year
- An implementation of various in-memory concurrency control protocols☆29Mar 30, 2024Updated 2 years ago
- [ICML 2025] AdaDecode: Accelerating LLM Decoding with Adaptive Layer Parallelism☆20Jul 14, 2025Updated last year
- [ICML 2025] Retraining-Free Merging of Sparse MoE via Hierarchical Clustering☆25Oct 26, 2025Updated 11 months ago
- Data movement for the WLCG world and beyond☆14Jul 28, 2026Updated 2 months ago
- ☆25Jun 1, 2025Updated last year
- MLSys 自学笔记 — with hand-written runnable code☆35Oct 9, 2026Updated 2 weeks ago
- Default Logseq dark theme with 0 saturation background and some other tweaks.☆34Oct 6, 2022Updated 4 years ago
- Systematic and comprehensive benchmarks for LLM systems.☆61Jan 28, 2026Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Sequence-level 1F1B schedule for LLMs.☆37Aug 26, 2025Updated last year
- 复旦大学谢启鸿老师的高等代数学手写笔记☆29Nov 7, 2020Updated 5 years ago
- ☆17Apr 10, 2024Updated 2 years ago
- Inverse Constitutional AI [ICLR 2025]: compressing pairwise preference data into a short constitution of principles.☆43May 6, 2026Updated 5 months ago
- Continuous Pipelined Speculative Decoding☆22May 25, 2026Updated 4 months ago
- The speculative decoding for uav environment☆17Oct 18, 2025Updated last year
- Local inference platform for K/IQ-quant GGUF models on Apple Silicon☆43Updated this week