Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature set.
☆118May 12, 2026Updated last week
Alternatives and similar repositories for omni-infer
Users that are interested in omni-infer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SELL OPEN!! Sniping token. Purchase of tokens during listing on exchanges such as Binance, MEXC, OKEX, Huobi and Gate.io . Buy the very f…☆11Feb 27, 2024Updated 2 years ago
- Implementation of Federated Learning For Mobile Keyboard Prediction: https://arxiv.org/abs/1811.03604☆10Jun 25, 2020Updated 5 years ago
- Prototyp MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism☆31Apr 4, 2025Updated last year
- ☆56Jul 7, 2025Updated 10 months ago
- High-performance distributed data shuffling (all-to-all) library for MoE training and inference☆120Mar 7, 2026Updated 2 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- 一步步通关GPU编程☆40Updated this week
- A record of reading list on some MLsys popular topic☆24Mar 20, 2025Updated last year
- [ICML 2026] Reasoning in Parallelism via Self-Distilled RL☆110Feb 5, 2026Updated 3 months ago
- A better wrapper for using RDMA programming APIs in Rust flavor☆83May 10, 2026Updated last week
- The ANUBIS benchmark suite for Incremental Synthesis☆12Dec 15, 2020Updated 5 years ago
- ☆18Jun 3, 2023Updated 2 years ago
- Variants of the Kaczmarz algorithm for solving linear systems in Python.☆13Sep 4, 2025Updated 8 months ago
- Quaternion Convolutional Neural Networks: A novel approach that extends traditional convolutional neural networks by introducing quaterni…☆20May 3, 2024Updated 2 years ago
- Just add the link the input field and click submit. It will give you direct link☆15Aug 30, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 用于学习“从零开始重写sylar C++高性能分布式服务器框架“，添加了很多注解和文档方便学习☆12Feb 28, 2024Updated 2 years ago
- Community maintained hardware plugin for vLLM on Ascend☆2,077Updated this week
- ☆39Jan 10, 2026Updated 4 months ago
- original 8bit CPU of ICF3-Z☆12Feb 20, 2020Updated 6 years ago
- Development containers for triton and triton-cpu☆27May 10, 2026Updated last week
- ☆47Sep 8, 2025Updated 8 months ago
- The smallest 6502 / NES CPU simulator in JS (944b gzipped)☆15Mar 1, 2022Updated 4 years ago
- ☆223Sep 25, 2025Updated 7 months ago
- ☆149Mar 5, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆54Apr 28, 2026Updated 3 weeks ago
- ☆39Mar 6, 2026Updated 2 months ago
- PLM: Efficient Peripheral Language Models Hardware-Co-Designed for Ubiquitous Computing☆21Mar 18, 2025Updated last year
- ☆20Jun 3, 2020Updated 5 years ago
- Tool for comparing the run time and accuracy of minimizers on fit benchmarking problems☆16May 11, 2026Updated last week
- vLLM adapter for a TGIS-compatible gRPC server.☆55Updated this week
- [NeurIPS 2025] Scaling Speculative Decoding with Lookahead Reasoning☆69Oct 31, 2025Updated 6 months ago
- SYCL Registry☆15Nov 7, 2025Updated 6 months ago
- A small 6502 system build on a Lattice Icestick FPGA development board☆16Jun 24, 2019Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Deadline countdowns for high-quality academic venues relevant to blockchain☆28Apr 22, 2026Updated 3 weeks ago
- ☆20Apr 18, 2024Updated 2 years ago
- a simple new ISA nnISA and nnSOC nnCPU nnAs nnCc☆10Mar 15, 2020Updated 6 years ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated 8 months ago
- 北京理工大学大四小学期计算机组成原理部分☆10Sep 24, 2020Updated 5 years ago
- A CUDA kernel optimization toolkit for validation, benchmarking, Nsight Compute profiling, bottleneck analysis, and iterative tuning. It …☆162Apr 22, 2026Updated 3 weeks ago
- ☆107May 10, 2026Updated last week