High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.
☆18Mar 20, 2026Updated 4 months ago
Alternatives and similar repositories for fast_topk_batched
Users that are interested in fast_topk_batched are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- World's first Nintendo 3DS emulator for Apple devices based on Citra.☆18Apr 7, 2023Updated 3 years ago
- A framework for efficient model inference with omni-modality models☆29Jul 12, 2026Updated 3 weeks ago
- MiRAGE: A Multiagent Framework for Generating Multimodal Multihop Question-Answer Dataset for RAG Evaluation☆22Updated this week
- ☆33May 15, 2026Updated 2 months ago
- 🦙 Turn your idle Mac or GPU into a free public AI API — OpenAI-compatible, one command, zero config (Powered by Llama.cpp)☆24Jul 31, 2026Updated last week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- finetune method to create think/model/requires tags to allow LLMs to write programs for things they can calculate instead of hallucinatin…☆15Apr 8, 2026Updated 4 months ago
- A tiny application that disables the Windows keys of your keyboard. Very useful in games!☆28May 12, 2023Updated 3 years ago
- collection of utilities for file manipulation in golang☆13Oct 4, 2023Updated 2 years ago
- Your AI terminal companion☆39Apr 30, 2026Updated 3 months ago
- this is an easy way to make ai podcast useing ai loccaly like ollama and the tts of piper☆16Feb 17, 2026Updated 5 months ago
- CarbonMU was experiments towards a general-purpose, extendable MUD/MUSH server written in Ruby.☆13Aug 26, 2017Updated 8 years ago
- A ComfyUI extension that enables seamless sharing of AI-generated images and videos directly to Discord.☆13May 9, 2026Updated 3 months ago
- peng - colibri-style streaming MoE engine for MiMo-V2.5 (311B) on consumer hardware☆19Jul 20, 2026Updated 3 weeks ago
- OBS FFMpegInput Plugin☆15Apr 6, 2013Updated 13 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- GPU-accelerated voice assistant — local LLM, fine-tuned Whisper, Kokoro TTS, AMD ROCm☆19Apr 2, 2026Updated 4 months ago
- Kolosal AI is an OpenSource and Lightweight alternative to Ollama to run LLMs 100% offline on your device.☆15Jan 2, 2026Updated 7 months ago
- A Prometheus metrics exporter for NVIDIA DGX Spark clusters.☆19Feb 16, 2026Updated 5 months ago
- Based on the AberMUD V source code by Alan Cox☆13Nov 21, 2016Updated 9 years ago
- Offline LLM chatbot with personalized memory — works on CPU with multi-session memory support.☆22Jan 10, 2026Updated 6 months ago
- Specialized fork for (relatively) fast single-GPU inference (in CUDA) using large MoE models that don't fit fully into VRAM☆17May 6, 2026Updated 3 months ago
- High-performance K-line (Candlestick) chart for React Native, powered by Skia. Smooth, customizable, and built for real trading apps.☆19Mar 20, 2026Updated 4 months ago
- SLMs for personal expenses summaries☆23Dec 20, 2025Updated 7 months ago
- Sample game project using the Godot engine.☆14Feb 27, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Huge f*cking file delta copy☆10Aug 3, 2025Updated last year
- A fork of the GroundZero2 codebase with bug fixes, standardization, and sanity-related changes.☆11Jan 7, 2022Updated 4 years ago
- A zero-config OpenAI client with support for 20+ providers, API key rotation, rate limits, optional LangChain integration and more.☆19Dec 11, 2025Updated 7 months ago
- An Open-Source Modular AI Assistant☆32Mar 20, 2025Updated last year
- CVE-2023-34362: MOVEit Transfer Unauthenticated RCE☆19Jul 30, 2026Updated last week
- Jarvis made by Kaushik Shresth Reverse Engineered by Likhi☆16Feb 16, 2025Updated last year
- ☆13Mar 28, 2024Updated 2 years ago
- Text adventure and MUD engine with AI NPCs, Discord integration, and Stable Diffusion visuals☆15Jun 23, 2024Updated 2 years ago
- Fork of the Flightaware dump1090 code base with an additional branch for integration with the EOSS SDR system.☆19Jul 8, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A powerful CLI tool to manage, test, and optimize RAG pipelines. Streamline your Retrieval-Augmented Generation workflows from terminal.☆23Jan 12, 2026Updated 6 months ago
- Reva Forth (public-domain x86 Forth)☆21Jul 30, 2020Updated 6 years ago
- ☆19Oct 13, 2025Updated 9 months ago
- ☆19Mar 19, 2026Updated 4 months ago
- Training Hierarchical Reasoning Models for next-token prediction.☆40Aug 7, 2025Updated last year
- My fork of microsoft/semanticworkbench☆14Oct 15, 2024Updated last year
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 10 months ago