JittorInfer is a high-performance C++ inference framework designed for large language models on Huawei's Ascend AI processor.
☆82Jun 10, 2026Updated 3 weeks ago
Alternatives and similar repositories for JittorInfer
Users that are interested in JittorInfer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Compact and Agent-Native MoE Training System☆224Jun 30, 2026Updated last week
- An experimental parallel training platform☆57Mar 25, 2024Updated 2 years ago
- Face detection with alignment from unconstrained photos☆12Sep 29, 2015Updated 10 years ago
- 一步步通关GPU编程☆52Jun 4, 2026Updated last month
- How to use node-local MPI rank IDs to manually map MPI ranks to GPUs☆14Apr 22, 2020Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- LLM inference in C/C++☆11Updated this week
- An implementation of the Latent Skill Embedding model☆10Feb 19, 2016Updated 10 years ago
- ☆41Jan 10, 2026Updated 5 months ago
- [Archived] For the latest updates and community contribution, please visit: https://github.com/Ascend/TransferQueue or https://gitcode.co…☆16Jan 16, 2026Updated 5 months ago
- Using OpenVINO to speed up inference of PaddleOCR-VL model☆36Apr 23, 2026Updated 2 months ago
- TiledKernel is a code generation library based on macro kernels and memory hierarchy graph data structure.☆19May 12, 2024Updated 2 years ago
- A configurable general purpose graphics processing unit for☆12May 18, 2019Updated 7 years ago
- A field theory inspired xAct package for Mathematica☆17Jul 28, 2016Updated 9 years ago
- A simple PyTorch implementation of CLIP model using DinoV2 and BERT☆15Sep 26, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Simple virtual machine for a stack-based assembler language.☆21Oct 15, 2017Updated 8 years ago
- Prototyp MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism☆31Apr 4, 2025Updated last year
- Dependency-Aware Structural Retrieval for Massive Agent Skills☆184May 4, 2026Updated 2 months ago
- A C/C++/python implementation of Deformable Part Based Model☆23Apr 25, 2013Updated 13 years ago
- 把这里当网盘了,因为需要差异性更新所以就放这儿了☆15Mar 2, 2016Updated 10 years ago
- Specifications and safety proofs in different tools of a simple concurrent algorithm☆24May 24, 2020Updated 6 years ago
- ☆13Jun 17, 2021Updated 5 years ago
- ☆15Feb 1, 2016Updated 10 years ago
- A CUDA kernel optimization toolkit for validation, benchmarking, Nsight Compute profiling, bottleneck analysis, and iterative tuning. It …☆187Apr 22, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- B站直播间的弹幕AI机器人☆15Mar 3, 2019Updated 7 years ago
- A simple OperatingSystem☆10Sep 9, 2022Updated 3 years ago
- High-performance distributed data shuffling (all-to-all) library for MoE training and inference☆123Mar 7, 2026Updated 4 months ago
- Interesting Articles in Software Engineering☆13Feb 27, 2020Updated 6 years ago
- Source code analysis of Impala, PostgreSQL, Citus and Postgres-XL☆13Jan 16, 2017Updated 9 years ago
- a presto plugin supporting read csv files in local filesystem.☆10Jul 27, 2018Updated 7 years ago
- infobright是一款 列式数据库分析开源软件，适合小型的数据分析数据库☆13Aug 29, 2017Updated 8 years ago
- Boost hardware utilization for ML training workloads via Inter-model Horizontal Fusion☆32May 15, 2024Updated 2 years ago
- Simple car and pedestrian detection in video using "openCV" library☆11Nov 15, 2019Updated 6 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Source for Demystifying GPU Microarchitecture through Microbenchmarking☆18May 29, 2023Updated 3 years ago
- 文档项目☆13Jun 2, 2026Updated last month
- The curated list of awesome C++ Coroutine resources.☆25Mar 8, 2024Updated 2 years ago
- 📝The official repository of "Rethinking Cross-Generator Image Forgery Detection through DINOv3"☆25Dec 2, 2025Updated 7 months ago
- A better wrapper for using RDMA programming APIs in Rust flavor☆93Jul 1, 2026Updated last week
- SGLang kernel library for NPU☆153Jul 2, 2026Updated last week
- GoTask is a powerful task management system for Go, providing flexible task orchestration, lifecycle management, and error handling mecha…☆77Updated this week