High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.
☆18Mar 20, 2026Updated 5 months ago
Alternatives and similar repositories for fast_topk_batched
Users that are interested in fast_topk_batched are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- World's first Nintendo 3DS emulator for Apple devices based on Citra.☆18Apr 7, 2023Updated 3 years ago
- A conversational AI system using Ollama with persistent memory capabilities. Features hybrid context management (sliding window + vector …☆22Mar 20, 2026Updated 5 months ago
- MiRAGE: A Multiagent Framework for Generating Multimodal Multihop Question-Answer Dataset for RAG Evaluation☆24Aug 5, 2026Updated last month
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆33Aug 15, 2026Updated last month
- Turn any Mac or GPU into an OpenAI-compatible inference node. One-command setup, automatic HTTPS, model management, and distributed reque…☆25Sep 5, 2026Updated 2 weeks ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Learn anything with Local Personalized Learning AI App☆30Aug 4, 2026Updated last month
- collection of utilities for file manipulation in golang☆13Oct 4, 2023Updated 2 years ago
- this is an easy way to make ai podcast useing ai loccaly like ollama and the tts of piper☆16Feb 17, 2026Updated 7 months ago
- ☆11Sep 15, 2015Updated 11 years ago
- An old-school computer roleplaying game inspired by the early Ultima games written with LÖVE; The tileset used was created by Josh Steele…☆10Apr 30, 2018Updated 8 years ago
- An emulator of x86 assembly with indicators for registers and memories on web browser.☆11Dec 15, 2023Updated 2 years ago
- Kolosal AI is an OpenSource and Lightweight alternative to Ollama to run LLMs 100% offline on your device.☆15Jan 2, 2026Updated 8 months ago
- GPU-accelerated voice assistant — local LLM, fine-tuned Whisper, Kokoro TTS, AMD ROCm☆25Apr 2, 2026Updated 5 months ago
- ☆24Nov 4, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A Prometheus metrics exporter for NVIDIA DGX Spark clusters.☆25Feb 16, 2026Updated 7 months ago
- Automated parameter sweep pipeline for finding optimal sampling settings for any local LLM on quantized weights☆22Feb 21, 2026Updated 6 months ago
- Kills connections by process ID☆11Oct 21, 2018Updated 7 years ago
- Based on the AberMUD V source code by Alan Cox☆13Nov 21, 2016Updated 9 years ago
- Offline LLM chatbot with personalized memory — works on CPU with multi-session memory support.☆22Jan 10, 2026Updated 8 months ago
- Origin is a survival MMO game (Java server and Java client)☆10Oct 1, 2018Updated 7 years ago
- So, I trained a Llama a 130M architecture I coded from ground up to build a small instruct model from scratch. Trained on FineWeb dataset…☆17Mar 26, 2025Updated last year
- This is creating a TCP Server using Rust programming language☆14Oct 3, 2023Updated 2 years ago
- ☆12Jan 22, 2016Updated 10 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆11Mar 18, 2026Updated 6 months ago
- Deterministic-mode checks for LLM inference: measure run/batch variance, generate repro packs, and explain why outputs differ.☆20Aug 20, 2026Updated 3 weeks ago
- A Dwarf Fortress clone☆19Feb 15, 2018Updated 8 years ago
- SLMs for personal expenses summaries☆23Sep 7, 2026Updated last week
- Sample game project using the Godot engine.☆14Feb 27, 2019Updated 7 years ago
- Pollinations.ai Native Plugin for OpenCode. Access Free and Enterprise AI models directly in your editor.☆23Sep 10, 2026Updated last week
- Huge f*cking file delta copy☆10Aug 3, 2025Updated last year
- Plug-and-play terminal security layer for LLM agents. Drop-in gatekeeper that prevents dangerous shell commands. Works with OpenAI, Claud…☆24Jan 29, 2026Updated 7 months ago
- An API for VoiceCraft.☆25Jun 27, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A fork of the GroundZero2 codebase with bug fixes, standardization, and sanity-related changes.☆11Jan 7, 2022Updated 4 years ago
- @ swap drop (forth rogue). docforth processed code at☆16Jan 1, 2019Updated 7 years ago
- ☆15Oct 25, 2024Updated last year
- An Open-Source Modular AI Assistant☆32Mar 20, 2025Updated last year
- 学习 知乎专栏《高品质游戏开发》中的《从零开始手敲次世代游戏引擎》系列 用的 repo☆13Nov 16, 2018Updated 7 years ago
- CVE-2023-34362: MOVEit Transfer Unauthenticated RCE☆19Jul 30, 2026Updated last month
- Text adventure and MUD engine with AI NPCs, Discord integration, and Stable Diffusion visuals☆15Jun 23, 2024Updated 2 years ago