Sparse Inferencing for transformer based LLMs
☆218Mar 25, 2026Updated 2 months ago
Alternatives and similar repositories for sparse_transformers
Users that are interested in sparse_transformers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Batch Implementation for Kokoro for enhanced on-device performance☆30May 10, 2025Updated last year
- ☆19Feb 23, 2026Updated 3 months ago
- SwiftLet is a lightweight Python framework for running open-source Large Language Models (LLMs) locally using safetensors☆29Aug 6, 2025Updated 9 months ago
- Train small sequence models in your browser with WebGPU.☆34Dec 3, 2025Updated 5 months ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆17Aug 30, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16Feb 1, 2025Updated last year
- Orpheus TTS Server with streaming support (TTFB ~160ms)☆26Sep 21, 2025Updated 8 months ago
- AI Based "Happiness Optimizer"☆12Oct 20, 2024Updated last year
- Deploying full-stack on-prem deep research agent that can be run entirely on a local machine for $0!☆34Nov 8, 2025Updated 6 months ago
- ☆12Aug 1, 2025Updated 9 months ago
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain w…☆130May 11, 2026Updated 2 weeks ago
- HippocampAI — Autonomous Memory Engine for LLM Agents☆66May 9, 2026Updated 2 weeks ago
- ☆15Mar 18, 2026Updated 2 months ago
- An MCP server that can spawn linux sandbox containers using docker and run commands in them via a TTY interface.☆26Sep 18, 2025Updated 8 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- SoTA open-source TTS☆156Dec 16, 2025Updated 5 months ago
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆25Dec 20, 2024Updated last year
- *NIX SHELL with Local AI/LLM integration☆26Feb 26, 2025Updated last year
- ☆21Feb 14, 2026Updated 3 months ago
- A simple no-install web UI for Ollama and OAI-Compatible APIs!☆31Jan 30, 2025Updated last year
- Teaching AI to play the classic text adventure Zork using Large Language Models☆37Apr 5, 2026Updated last month
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆60Dec 1, 2024Updated last year
- Generate Your Own Private Morning Radio for Commute☆32Feb 5, 2025Updated last year
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- My version of an LLM Websearch Agent using a local SearXNG server because SearXNG is great.☆45Jan 27, 2026Updated 3 months ago
- Various LLM Benchmarks☆26Feb 20, 2026Updated 3 months ago
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆19Sep 13, 2024Updated last year
- A highly optimized engine for neutts-air model to generate minutes of audio in seconds. Over 200x realtime on modern hardware!☆119Nov 24, 2025Updated 6 months ago
- A local-first LLM development studio. Build, test, and customize inference workflows with your own models — no cloud, totally local.☆17May 21, 2025Updated last year
- Run Orpheus 3B Locally with Gradio UI, Standalone App☆24Apr 1, 2025Updated last year
- A Python-based AI coding assistant that uses the Gemini API for code generation, file manipulation, and interactive software development …☆23Jun 28, 2025Updated 10 months ago
- FlashKDA: high-performance Kimi Delta Attention kernels☆428Apr 22, 2026Updated last month
- ☆63Jul 10, 2025Updated 10 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- llmBench is a high-depth benchmarking tool designed to measure the raw performance of local LLM runtimes (Ollama, llama.cpp) while provid…☆45Mar 15, 2026Updated 2 months ago
- ☆31Mar 3, 2025Updated last year
- Eternal is an experimental platform for machine learning models and workflows.☆70Mar 9, 2025Updated last year
- LexiCrawler is a powerful Go-based web crawling API meticulously designed to extract, clean, and transform web page content into a pristi…☆48Feb 27, 2025Updated last year
- DeepFloyd IF web UI☆30May 7, 2023Updated 3 years ago
- ☆24Jan 22, 2025Updated last year
- PromptRose 🌹 is your AI prompt companion, blooming at your fingertips.☆22Sep 1, 2025Updated 8 months ago