High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.
☆18Mar 20, 2026Updated 7 months ago
Alternatives and similar repositories for fast_topk_batched
Users that are interested in fast_topk_batched are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- nagi-llm is a modern evolution of the NAGI interpreter, enhanced with AI and LLM-driven scripting.☆14Dec 17, 2025Updated 11 months ago
- A conversational AI system using Ollama with persistent memory capabilities. Features hybrid context management (sliding window + vector …☆22Mar 20, 2026Updated 7 months ago
- An example repo full of Douglas Adams quotes☆16Mar 12, 2024Updated 2 years ago
- Scripts to setup a two-node llama.cpp cluster on NVIDIA DGX Spark (GB10) hardware.☆12May 10, 2026Updated 6 months ago
- A pi coding-agent terminal running entirely in the browser with Ghostty Web and Pyodide☆13Oct 22, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆34Aug 24, 2026Updated 2 months ago
- A Python library of test functions from the uncertainty quantification community with a common interface for validation and benchmarking …☆13Oct 22, 2026Updated 3 weeks ago
- MRS-Core provides a transparent, modular, reproducible reasoning substrate.☆11Feb 3, 2026Updated 9 months ago
- 🎓 Free course on deterministic AI verification and AISecOps. Learn fail-closed AI architecture, formal verification, audit integrity, MC…☆12Nov 5, 2026Updated last week
- ☆10Jul 31, 2026Updated 3 months ago
- Interpost AI Internal Links (formally "Contextual Link Weaver") is an intelligent internal linking assistant for WordPress that uses the …☆14Sep 3, 2026Updated 2 months ago
- Real-time CSI sensing system for multi-device Wi-Fi signal processing, Butterworth-based filtering, and deep learning-based activity & lo…☆14Apr 1, 2026Updated 7 months ago
- Site for awarding and setting custom flairs☆13Jul 22, 2026Updated 3 months ago
- A full, unpruned 177B MoE model at 11.5 tok/s on one 12 GB GPU. Expert streaming for llama.cpp, with the measurement harness and every de…☆25Oct 3, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- One image in, one 3D Gaussian-splat .ply out. Self-hosted Docker service with a web gallery, 3D viewer, HTTP API and MCP server.☆24Nov 6, 2026Updated last week
- Sherpa-onnx-tts-stt source for homeassisstant addon with Kroko Onnx Streaming STT integration.☆34Dec 18, 2025Updated 10 months ago
- this is an easy way to make ai podcast useing ai loccaly like ollama and the tts of piper☆17Feb 17, 2026Updated 9 months ago
- Wireless file sharing between Steam Deck and phone/PC☆17Oct 14, 2026Updated last month
- An emulator of x86 assembly with indicators for registers and memories on web browser.☆11Dec 15, 2023Updated 2 years ago
- The "keep it simple" backtesting framework☆13Mar 6, 2026Updated 8 months ago
- Geometric Flow Networks☆12Aug 8, 2026Updated 3 months ago
- A toolkit for Weight-Space Programming / Reading☆41Updated this week
- An old-school computer roleplaying game inspired by the early Ultima games written with LÖVE; The tileset used was created by Josh Steele…☆10Apr 30, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Cross-Embodiment Video World Models are Zero-Shot Physical Simulators☆14Aug 25, 2026Updated 2 months ago
- Creating AI agents with the simplicity of Python in Java.☆14Mar 21, 2026Updated 7 months ago
- An AI-powered agent system generating and verifying Lean 4 code, translating natural language problems into formally proven programs usin…☆22May 30, 2025Updated last year
- A friendly Linux UI for local AI: chat, agent, models, backends, all in one☆22Updated this week
- Python Script that Swaps Eyes☆11Jul 30, 2025Updated last year
- Offline LLM chatbot with personalized memory — works on CPU with multi-session memory support.☆22Jan 10, 2026Updated 10 months ago
- What's your LLM's personality? Measure warmth, patience, confidence and 5 more axes from hidden states.☆14Jul 29, 2026Updated 3 months ago
- ☆11Mar 18, 2026Updated 8 months ago
- ☆11Sep 15, 2015Updated 11 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆14Jan 6, 2025Updated last year
- ☆10Dec 18, 2025Updated 10 months ago
- SLMs for personal expenses summaries☆23Sep 7, 2026Updated 2 months ago
- a terminal-based performance monitor for apple silicon☆21Jul 13, 2025Updated last year
- @ swap drop (forth rogue). docforth processed code at☆16Jan 1, 2019Updated 7 years ago
- The exercise for the user level thread programming☆14Dec 15, 2020Updated 5 years ago
- Huge f*cking file delta copy☆10Aug 3, 2025Updated last year
Are these results useful?