JittorInfer is a high-performance C++ inference framework designed for large language models on Huawei's Ascend AI processor.
☆83Mar 2, 2026Updated 2 months ago
Alternatives and similar repositories for JittorInfer
Users that are interested in JittorInfer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Feb 14, 2023Updated 3 years ago
- A magnet widget for kivy garden☆12Aug 10, 2019Updated 6 years ago
- Radam+lookahead implemented by tensorflow☆11Oct 14, 2019Updated 6 years ago
- [ICML 2026] Reasoning in Parallelism via Self-Distilled RL☆112Feb 5, 2026Updated 3 months ago
- ☆39Jan 10, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [Archived] For the latest updates and community contribution, please visit: https://github.com/Ascend/TransferQueue or https://gitcode.co…☆15Jan 16, 2026Updated 4 months ago
- ☆47Sep 8, 2025Updated 8 months ago
- Ask question to your PDF☆10Jun 11, 2023Updated 2 years ago
- ☆13Sep 3, 2018Updated 7 years ago
- Simple virtual machine for a stack-based assembler language.☆21Oct 15, 2017Updated 8 years ago
- Prototyp MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism☆31Apr 4, 2025Updated last year
- A CUDA kernel optimization toolkit for validation, benchmarking, Nsight Compute profiling, bottleneck analysis, and iterative tuning. It …☆168Apr 22, 2026Updated last month
- ⚡Harry Potter books and audiobooks☆12Oct 1, 2020Updated 5 years ago
- Specifications and safety proofs in different tools of a simple concurrent algorithm☆24May 24, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A curated list of bookmarks, packages, tutorials, videos and other cool resources done in Chapel language.☆21Apr 12, 2021Updated 5 years ago
- ☆19Mar 9, 2025Updated last year
- High-performance distributed data shuffling (all-to-all) library for MoE training and inference☆120Mar 7, 2026Updated 2 months ago
- infobright是一款列式数据库分析开源软件，适合小型的数据分析数据库☆13Aug 29, 2017Updated 8 years ago
- Source for Demystifying GPU Microarchitecture through Microbenchmarking☆18May 29, 2023Updated 3 years ago
- ☆56Jul 7, 2025Updated 10 months ago
- Verification-Driven Development☆21Mar 26, 2021Updated 5 years ago
- A pure-Python implementation of the Nvidia CuTe layout algebra intended to be approachable and easy to learn.☆181May 15, 2026Updated 2 weeks ago
- A better wrapper for using RDMA programming APIs in Rust flavor☆84Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆21Jun 9, 2025Updated 11 months ago
- MultiArchKernelBench: A Multi-Platform Benchmark for Kernel Generation☆53Updated this week
- SGLang kernel library for NPU☆137May 21, 2026Updated last week
- GoTask is a powerful task management system for Go, providing flexible task orchestration, lifecycle management, and error handling mecha…☆76Dec 19, 2025Updated 5 months ago
- ☆24May 22, 2026Updated last week
- Efficient operation implementation based on the Cambricon Machine Learning Unit (MLU) .☆165May 18, 2026Updated last week
- A fast and accurate reuse distance analyzer for multi-threaded applications. It leverages existing hardware features in commodity CPUs.☆21Feb 3, 2023Updated 3 years ago
- 列式数据库infobright安装、使用及备份☆16Feb 7, 2017Updated 9 years ago
- Docker image for managing Citus membership via docker-py☆22Aug 12, 2020Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆13May 11, 2026Updated 2 weeks ago
- Self-host LLMs with LMDeploy and BentoML☆22Dec 26, 2025Updated 5 months ago
- A Tensorflow implementation of "Real-time Scene Text Detection with Differentiable Binarization"☆20Dec 27, 2019Updated 6 years ago
- ☆24Nov 16, 2019Updated 6 years ago
- Research prototype of PRISM — a cost-efficient multi-LLM serving system with flexible time- and space-based GPU sharing.☆66Mar 17, 2026Updated 2 months ago
- 从零做操作系统☆25Mar 10, 2015Updated 11 years ago
- Scalable Distributed System Model Checking with Specification-Level State Exploration☆28Apr 24, 2024Updated 2 years ago