High-efficiency LLM inference engine in C++/CUDA. Run Llama 70B on RTX 3090.
☆465Feb 22, 2026Updated 4 months ago
Alternatives and similar repositories for ntransformer
Users that are interested in ntransformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Jul 12, 2025Updated 11 months ago
- Integrate Claude Code and Gemini CLI into your Obsidian workflow☆27May 28, 2026Updated last month
- Rust implementation of the Zstandard Seekable Format☆274Jul 2, 2026Updated last week
- Colibri is a next-generation social chat app built on the AT protocol.☆81Updated this week
- Experiments with the Mojo 🔥 programming language on macOS arm64 guided by tests☆13Jan 8, 2026Updated 6 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ⚡ Production-grade RAG chunking engine powered by Rust. Process GBs of CSV, PDF, JSON, JSONL, DOCX, XLSX, URLs, ETC., in seconds with O(1…☆48Feb 28, 2026Updated 4 months ago
- Automatically exported from code.google.com/p/smhasher☆16Mar 10, 2021Updated 5 years ago
- A quantum chemisty library in jax.☆44Feb 14, 2026Updated 4 months ago
- Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and in…☆18Nov 11, 2024Updated last year
- ☆127May 17, 2026Updated last month
- Questions for managers to use in 1on1 meetings, hiring and firing conversations, feedback, performance reviews, yearly, and team growth. …☆36Dec 18, 2025Updated 6 months ago
- A lightweight, feature-rich dock for Linux written in Python with GTK 3 and Cairo☆59Updated this week
- Server for Matching Long/Lat to Timezone☆47Feb 21, 2026Updated 4 months ago
- Tokenflood is a load testing framework for simulating arbitary loads on instruction-tuned LLMs☆46Jul 1, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A simple backtracking regex engine written in JavaScript☆11Oct 4, 2015Updated 10 years ago
- A comprehensive suite of tools, built to liberate science by making the creation, evaluation, and dissemination of research more transpar…☆251Aug 8, 2025Updated 11 months ago
- Paced resonance breathing in your terminal☆318Jun 12, 2026Updated 3 weeks ago
- This repository contains code to process, compress, store, stream, and visualize dynamic and time-varying 4D geometry data.☆51Updated this week
- Wolfram Language / Mathematica reimplementation in Rust (Wolfram oxidized)☆642Updated this week
- Outrageous Voice Assistant - Fully local end-to-end ASR + LLM + TTS pipeline using open weight models and a simple web based UI☆148Mar 12, 2026Updated 3 months ago
- DiscoGrad - automatically differentiate across conditional branches in C++ programs☆210Sep 12, 2024Updated last year
- new optimizer☆20Aug 4, 2024Updated last year
- Tree-sitter-powered code indexing server that gives LLM agents precise, on-demand access to symbols, implementations, callers, tests, and…☆291May 4, 2026Updated 2 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- An AI coding skill that transforms project planning into visual, interactive HTML decision documents☆53Apr 9, 2026Updated 3 months ago
- Implementations of the Are-we-fast-yet benchmark suite in Oberon, C++, C, Pascal, Micron and Luon☆72May 30, 2026Updated last month
- An interactive visual explainer for Andrej Karpathy's microGPT☆41Mar 12, 2026Updated 3 months ago
- Docker-based inference engine for AMD GPUs☆234Oct 7, 2024Updated last year
- Extra event types built on top of rsevents☆17May 19, 2023Updated 3 years ago
- Postgres extensions in C++☆17May 25, 2026Updated last month
- Python helper to send proper HDMI-CEC frame to wake up AVR☆28Nov 17, 2025Updated 7 months ago
- A SQL transformation engine that type-checks your whole pipeline and catches breaking changes before they run — branches, replay, column-…☆269Updated this week
- A hassle-free utility to encrypt error handling strings in public binaries to protect business logic☆26Apr 29, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16Apr 20, 2024Updated 2 years ago
- 💭 Chat with AI via API☆33Oct 20, 2024Updated last year
- Zero-dependency C99 GPT-2 engine for edge AI. Sub-1M parameter models train on-device in seconds. Organelle Pipeline Architecture (OPA) c…☆111Jun 21, 2026Updated 2 weeks ago
- Interactive timeline visualization for Org-roam.☆37Jan 12, 2026Updated 5 months ago
- Inject some y2k energy into instagram☆14Sep 15, 2024Updated last year
- Open-source CUDA, Triton and HIP compiler targeting multiple GPU and CPU architectures.☆1,710Updated this week
- https://ansi.tools☆38May 17, 2026Updated last month