Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature set.
☆121Jun 3, 2026Updated this week
Alternatives and similar repositories for omni-infer
Users that are interested in omni-infer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆56Jul 7, 2025Updated 11 months ago
- 一步步通关GPU编程☆45Updated this week
- 基于树莓派ZREO BCM2835的简易树莓派操作系统 计算机科学与技术 操作系统课程设计☆32Feb 13, 2020Updated 6 years ago
- 使用pybind11进行Python、C++以及CUDA的混合编程☆11May 20, 2020Updated 6 years ago
- UnOfficial Gradio Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Y…☆16Sep 30, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A better wrapper for using RDMA programming APIs in Rust flavor☆85May 25, 2026Updated 2 weeks ago
- The ANUBIS benchmark suite for Incremental Synthesis☆12Dec 15, 2020Updated 5 years ago
- Variants of the Kaczmarz algorithm for solving linear systems in Python.☆13Sep 4, 2025Updated 9 months ago
- AI Hedge Fund Repo integrate with DeepSeek V3 and R1 hosted on SiliconFlow.☆12Feb 3, 2025Updated last year
- NVIDIA Inference Xfer Library (NIXL)☆1,072Updated this week
- Just add the link the input field and click submit. It will give you direct link☆16Aug 30, 2023Updated 2 years ago
- Community maintained hardware plugin for vLLM on Ascend☆2,203Updated this week
- original 8bit CPU of ICF3-Z☆12Feb 20, 2020Updated 6 years ago
- Development containers for triton and triton-cpu☆28Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Examples for KubeEdge☆13Sep 29, 2020Updated 5 years ago
- ☆47Sep 8, 2025Updated 9 months ago
- The smallest 6502 / NES CPU simulator in JS (944b gzipped)☆15Mar 1, 2022Updated 4 years ago
- ☆156Mar 5, 2026Updated 3 months ago
- ☆44Mar 6, 2026Updated 3 months ago
- PLM: Efficient Peripheral Language Models Hardware-Co-Designed for Ubiquitous Computing☆21Mar 18, 2025Updated last year
- A high-performance hardware acceleration algorithm library of OpenSSL engine based on Kunpeng processor☆44May 19, 2026Updated 3 weeks ago
- Tool for comparing the run time and accuracy of minimizers on fit benchmarking problems☆16Updated this week
- vLLM adapter for a TGIS-compatible gRPC server.☆55Jun 2, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Memory optimized Mixture of Experts☆77Jul 25, 2025Updated 10 months ago
- [NeurIPS 2025] Scaling Speculative Decoding with Lookahead Reasoning☆69Oct 31, 2025Updated 7 months ago
- SYCL Registry☆15Nov 7, 2025Updated 7 months ago
- A small 6502 system build on a Lattice Icestick FPGA development board☆16Jun 24, 2019Updated 6 years ago
- ☆20Apr 18, 2024Updated 2 years ago
- Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling☆217Updated this week
- a simple new ISA nnISA and nnSOC nnCPU nnAs nnCc☆10Mar 15, 2020Updated 6 years ago
- A collection of resources and papers on diffusion models of video generation.☆10Feb 11, 2023Updated 3 years ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 北京理工大学大四小学期计算机组成原理部分☆10Sep 24, 2020Updated 5 years ago
- A CUDA kernel optimization toolkit for validation, benchmarking, Nsight Compute profiling, bottleneck analysis, and iterative tuning. It …☆174Apr 22, 2026Updated last month
- ☆18Apr 13, 2026Updated last month
- ☆19Aug 4, 2025Updated 10 months ago
- [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts☆39Feb 29, 2024Updated 2 years ago
- [SDM24] Official code for "Time-Transformer"☆18Sep 30, 2025Updated 8 months ago
- Awesome-Parallel-Reasoning: Unlocking the reasoning potential of LLMs. Papers, Code, Resources & Survey.☆53Mar 8, 2026Updated 3 months ago