Lightweight Python Wrapper for OpenVINO, enabling LLM inference on NPUs
☆29Dec 17, 2024Updated last year
Alternatives and similar repositories for nitro
Users that are interested in nitro are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SGLang kernel library for Intel XPU☆27Updated this week
- (WIP) Parallel inference for black-forest-labs' FLUX model.☆19Nov 18, 2024Updated last year
- A forked version of flux-fast that makes flux-fast even faster with cache-dit, 3.3x speedup on NVIDIA L20.☆24Jul 18, 2025Updated last year
- ☆23Aug 14, 2024Updated last year
- ☆13Jul 10, 2026Updated 2 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Various LLM Benchmarks☆26Feb 20, 2026Updated 5 months ago
- Multi-Layer Key-Value sharing experiments on Pythia models☆34Jun 14, 2024Updated 2 years ago
- Cluster doctor skills☆14May 23, 2026Updated 2 months ago
- ☆16Aug 19, 2024Updated last year
- Highlighting of searches via star, auto-highlighting.☆16Mar 14, 2023Updated 3 years ago
- Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.☆92Nov 23, 2022Updated 3 years ago
- Bib(la)tex citations for vim☆16Oct 16, 2024Updated last year
- Codeplay's tutorial LLDB-MSP430 - as presented at the 2016 EuroLLVM Developers' Meeting in Barcelona.☆10Mar 15, 2016Updated 10 years ago
- A script to reorganize 'Want to go' Saved places in Google Maps into separate lists by category.☆11May 14, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 很好用的tnn classify demo☆11Mar 24, 2021Updated 5 years ago
- ☆16May 20, 2019Updated 7 years ago
- TriScale software☆14Apr 23, 2024Updated 2 years ago
- SGLang kernel library for NPU☆170Updated this week
- ☆21Updated this week
- Tools and APIs to develop weavers for the LARA language (LARA Compiler, LARA Interpreter, Weaver Generator, etc...)☆16Jul 15, 2026Updated last week
- DISB is a new DNN inference serving benchmark with diverse workloads and models, as well as real-world traces.☆58Aug 21, 2024Updated last year
- [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving☆344Jul 2, 2024Updated 2 years ago
- This adds partial support of AVX2 and AVX-512 to gem5.☆15Dec 19, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆10Dec 10, 2024Updated last year
- a C implementation of Simon Cooke's bipbuffer☆18Aug 11, 2017Updated 8 years ago
- ☆15May 13, 2024Updated 2 years ago
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆115Jun 28, 2025Updated last year
- Unlimited Vector Extension with Data Streaming Support☆12Nov 25, 2024Updated last year
- ☆15Jan 28, 2025Updated last year
- ☆65Apr 26, 2025Updated last year
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆62Oct 11, 2024Updated last year
- [ECCV 2024] Efficient Inference of Vision Instruction-Following Models with Elastic Cache☆43Jul 26, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆14Mar 5, 2024Updated 2 years ago
- Anonymous, decentralised, git-based webpages for Akash and Radicle.☆21Oct 19, 2021Updated 4 years ago
- CPUs☆17Dec 21, 2020Updated 5 years ago
- Fast low-bit matmul kernels in Triton☆477Jul 15, 2026Updated last week
- ☆15Apr 15, 2026Updated 3 months ago
- 腾讯优图开放平台 c++ sdk☆15Apr 10, 2019Updated 7 years ago
- A fast function (SIMD-accelerated) for finding the minimum and maximum value in a NumPy array☆15Updated this week