High-efficiency LLM inference engine in C++/CUDA. Run Llama 70B on RTX 3090.
☆461Feb 22, 2026Updated 2 months ago
Alternatives and similar repositories for ntransformer
Users that are interested in ntransformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Rust implementation of the Zstandard Seekable Format☆265Apr 17, 2026Updated 2 weeks ago
- Experiments with the Mojo 🔥 programming language on macOS arm64 guided by tests☆13Jan 8, 2026Updated 3 months ago
- DeepDream for video with temporal consistency. Features RAFT optical flow estimation and occlusion masking to prevent ghosting. A PyTorch…☆63Jan 2, 2026Updated 4 months ago
- Automatically exported from code.google.com/p/smhasher☆16Mar 10, 2021Updated 5 years ago
- Single-file, pure CUDA C implementation for running inference on Qwen3 0.6B GGUF. No Dependencies.☆24Nov 26, 2025Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A lightweight, feature-rich dock for Linux written in Python with GTK 3 and Cairo☆49Updated this week
- A quantum chemisty library in jax.☆41Feb 14, 2026Updated 2 months ago
- Minimal implementation of a Byte Pair Encoding (BPE) tokenizer in Zig☆14Apr 7, 2025Updated last year
- Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and in…☆18Nov 11, 2024Updated last year
- Server for Matching Long/Lat to Timezone☆47Feb 21, 2026Updated 2 months ago
- sigma-MoE layer☆21Jan 5, 2024Updated 2 years ago
- Tokenflood is a load testing framework for simulating arbitary loads on instruction-tuned LLMs☆45Apr 26, 2026Updated last week
- A comprehensive suite of tools, built to liberate science by making the creation, evaluation, and dissemination of research more transpar…☆248Aug 8, 2025Updated 8 months ago
- DiscoGrad - automatically differentiate across conditional branches in C++ programs☆212Sep 12, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- new optimizer☆20Aug 4, 2024Updated last year
- A crate built on top of `axum-sessions`, implementing the CSRF Synchronizer Token Pattern☆15Apr 29, 2026Updated last week
- Implementations of the Are-we-fast-yet benchmark suite in Oberon, C++, C, Pascal, Micron and Luon☆69Apr 1, 2026Updated last month
- RISC-V emulator in Rust that boots Linux with JIT on ARM64/x86_64 and Sv39 virtual memory☆100Apr 7, 2026Updated 3 weeks ago
- Stress test for parallel disk i/o using git and pnpm☆31Mar 5, 2026Updated 2 months ago
- Docker-based inference engine for AMD GPUs☆233Oct 7, 2024Updated last year
- A straightforward zero-dependency in-memory database☆16Sep 1, 2016Updated 9 years ago
- ArxivTok 📚: Browse ArXiv papers with a TikTok-style vertical swipe interface.☆91Feb 7, 2025Updated last year
- dotfiles: karabiner, starship, tmux, skhd, yabai, alacritty☆18Apr 2, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 💭 Chat with AI via API☆33Oct 20, 2024Updated last year
- Use Civet in any project.☆15Jun 20, 2024Updated last year
- Inject some y2k energy into instagram☆15Sep 15, 2024Updated last year
- Open-source CUDA compiler targeting multiple GPU architectures. Compiles .cu to AMD and Tenstorrent GPU's☆1,670Apr 24, 2026Updated last week
- A simple app for downloading YouTube Shorts transcripts. Built to self-host with Python and Streamlit. Free and open source.☆32Dec 4, 2024Updated last year
- ☆252Mar 20, 2024Updated 2 years ago
- Read-through cache for object storage☆582Apr 26, 2026Updated last week
- Ideas, concepts, tools and examples of sketch programming☆23Dec 20, 2025Updated 4 months ago
- Filesystem 'at' implementations for Unix and Windows☆12Apr 26, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Resource and domain modeling for quick APIs, CMSs, and applications.☆26Jan 4, 2023Updated 3 years ago
- GraphTerm: An aspirational DevOps and Container IDE Concept☆27Nov 20, 2017Updated 8 years ago
- High-performance open-source synthetic data engine. Uses LLMs for schema design and vectorized NumPy for deterministic, scalable generati…☆55Updated this week
- Ruqe brings the convenient types and methods found in Rust into Dart, such as the Result, Option, pattern-matching, etc.☆13Sep 13, 2023Updated 2 years ago
- A library for building dynamic terminal apps, using bonsai☆145Apr 6, 2026Updated 3 weeks ago
- linux container runtime built with zig☆23Feb 15, 2025Updated last year
- A pretty GUD gadget☆16Nov 18, 2025Updated 5 months ago