High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.
☆18Mar 20, 2026Updated 7 months ago
Alternatives and similar repositories for fast_topk_batched
Users that are interested in fast_topk_batched are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- nagi-llm is a modern evolution of the NAGI interpreter, enhanced with AI and LLM-driven scripting.☆14Dec 17, 2025Updated 10 months ago
- Source code and dataset for the paper 'Saamayik: A Benchmark and Dataset for English-Sanskrit Translation'☆16Oct 11, 2025Updated last year
- A framework for efficient model inference with omni-modality models☆30Oct 20, 2026Updated last week
- A conversational AI system using Ollama with persistent memory capabilities. Features hybrid context management (sliding window + vector …☆22Mar 20, 2026Updated 7 months ago
- A pi coding-agent terminal running entirely in the browser with Ghostty Web and Pyodide☆12Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Production-speed compact Dynamic Memory Sparsification (DMS) for KV cache compression☆27May 6, 2026Updated 5 months ago
- Receive.Link: receive files only you can open.☆14Sep 7, 2026Updated last month
- An example repo full of Douglas Adams quotes☆16Mar 12, 2024Updated 2 years ago
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆33Oct 8, 2026Updated 3 weeks ago
- Training Coder Models with Critique Reinforcement Learning [ICLR26]☆13Apr 11, 2026Updated 6 months ago
- Outlook in your terminal☆21Updated this week
- An Efficent BPE Algorithm Faster then Hugging Face Tokenizer's Implementation☆13Sep 30, 2026Updated 3 weeks ago
- ☆33Aug 24, 2026Updated 2 months ago
- MiRAGE: A Multiagent Framework for Generating Multimodal Multihop Question-Answer Dataset for RAG Evaluation☆24Aug 5, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆30Oct 19, 2026Updated last week
- An AI-powered agent system generating and verifying Lean 4 code, translating natural language problems into formally proven programs usin…☆21May 30, 2025Updated last year
- Unofficial Elixir SDK for OpenCode☆15Oct 16, 2026Updated last week
- ☆11Jul 28, 2022Updated 4 years ago
- MRS-Core provides a transparent, modular, reproducible reasoning substrate.☆11Feb 3, 2026Updated 8 months ago
- Implementing RLS for Turso in a Cloudflare Worker☆37Aug 27, 2023Updated 3 years ago
- Turn any Mac or GPU into an OpenAI-compatible inference node. One-command setup, automatic HTTPS, model management, and distributed reque…☆26Sep 30, 2026Updated 3 weeks ago
- collection of utilities for file manipulation in golang☆13Oct 4, 2023Updated 3 years ago
- A full, unpruned 177B MoE model at 11.5 tok/s on one 12 GB GPU. Expert streaming for llama.cpp, with the measurement harness and every de…☆22Oct 3, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Learn anything with Local Personalized Learning AI App☆31Aug 4, 2026Updated 2 months ago
- finetune method to create think/model/requires tags to allow LLMs to write programs for things they can calculate instead of hallucinatin…☆15Apr 8, 2026Updated 6 months ago
- Cross-Embodiment Video World Models are Zero-Shot Physical Simulators☆14Aug 25, 2026Updated 2 months ago
- Site for awarding and setting custom flairs☆13Jul 22, 2026Updated 3 months ago
- A tiny application that disables the Windows keys of your keyboard. Very useful in games!☆27May 12, 2023Updated 3 years ago
- A Haiku-driven matching decompilation pipeline: Ghidra, an emulator-based test oracle, a strict checker and cheap model workers (Dreamcas…☆24Updated this week
- Turn a Windows 11 IoT LTSC PC into a couch gaming console: boots straight into Steam Big Picture, survives crashes, desktop only on deman…☆19Aug 24, 2026Updated 2 months ago
- The UnisonAI Multi-Agent Framework built on custom workflow which allows ai agents to talk together and provides a flexible and extensibl…☆23Feb 24, 2026Updated 8 months ago
- ☆10Jul 31, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Your AI terminal companion☆38Apr 30, 2026Updated 5 months ago
- this is an easy way to make ai podcast useing ai loccaly like ollama and the tts of piper☆17Feb 17, 2026Updated 8 months ago
- BBS MUD server and client☆13Sep 28, 2021Updated 5 years ago
- Wireless file sharing between Steam Deck and phone/PC☆16Oct 14, 2026Updated 2 weeks ago
- Easily edit websites temporarily by a click of a button.☆12Jan 27, 2026Updated 9 months ago
- An old-school computer roleplaying game inspired by the early Ultima games written with LÖVE; The tileset used was created by Josh Steele…☆10Apr 30, 2018Updated 8 years ago
- Qwen3.8-Flash-Next IQ3_S on 12 GB VRAM + 32 GB RAM + NVMe: ~45-50 tok/s decode, 131k context, Strata unify fork☆17Oct 18, 2026Updated last week