Turbo Lossless - 1.33x Smaller, 2.93x Faster, Decode with 1 ADD operation
☆15Apr 4, 2026Updated 3 months ago
Alternatives and similar repositories for Turbo-Lossless
Users that are interested in Turbo-Lossless are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆22Apr 3, 2026Updated 3 months ago
- ☆17Jun 4, 2026Updated last month
- Machine Learning based toxicity prediction tool for small molecules.☆11Feb 13, 2024Updated 2 years ago
- Simple vLLM container deployment for Qwen3-Omni-30B-A3B-Instruct with up-to-date CUDA☆35Sep 28, 2025Updated 9 months ago
- AutoREADME is an AI-powered tool that genereates a README file for any given input repository.☆34Oct 2, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- a transformer implemented primarily using einops and trained on the tinystories dataset☆14Jun 21, 2024Updated 2 years ago
- ☆39Jun 4, 2026Updated last month
- ☆51Oct 1, 2025Updated 9 months ago
- ☆25Mar 15, 2023Updated 3 years ago
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆31Apr 10, 2026Updated 3 months ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 10 months ago
- Yet another `llama.cpp` Rust wrapper☆12Updated this week
- A desktop GUI for Flux 1.1 Pro built using DelphiFMX For Python☆11Oct 5, 2024Updated last year
- Simple agent framework using Ollama tool calling☆10Aug 27, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The Lily programming language ⚜☆10Apr 7, 2026Updated 3 months ago
- A tiny I2C library written in V☆14May 15, 2024Updated 2 years ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆18Aug 30, 2024Updated last year
- Simple, lightweight transformers in Fortran☆16Nov 17, 2023Updated 2 years ago
- wav2lip-api☆11Mar 16, 2023Updated 3 years ago
- ☆35Updated this week
- One-Click RAG Implementation, Simple and Portable☆30Oct 5, 2025Updated 9 months ago
- Windows desktop application for Stable Diffusion☆13Jun 26, 2023Updated 3 years ago
- LCM Drawing app☆12Dec 1, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Haskell bindings to llama.cpp☆12Dec 22, 2023Updated 2 years ago
- [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive☆75Dec 11, 2025Updated 7 months ago
- Yet Another (LLM) Web UI, made with Gemini☆12Dec 25, 2024Updated last year
- Historical Language Model for London - A specialized LLM trained on 1500-1850 historical English text☆33Nov 1, 2025Updated 8 months ago
- Can AI Agents Build Bespoke LLM Serving Systems?☆81Updated this week
- An agentic runtime that enables secure, extensible and configurable AI automation from any model☆17Updated this week
- LLamaHTML is a simple html file to communicate with a running llamacpp llama-server☆24Aug 5, 2025Updated 11 months ago
- Компилятор "СтранниК Модула-Си-Паскаль"☆15Jun 12, 2016Updated 10 years ago
- A minimal CLI tool for piping anything into an LLM.☆21Jan 1, 2026Updated 6 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A free and open-source GUI tool that simplifies combining multiple code files into one, with automatic labeling and support for various p…☆14Jan 3, 2025Updated last year
- A universal adapter including zero-copy Python bindings for Philip Turner's metal flash attention library.☆29Updated this week
- ojjson is a library designed to facilitate JSON interactions with Ollama, a large language api (LLM). It leverages the power of Zod for s…☆12Nov 7, 2024Updated last year
- ☆11Sep 18, 2023Updated 2 years ago
- One Diffusion model implementation base on LibTorch☆13Mar 22, 2023Updated 3 years ago
- flux1非官方的量化模型(flux1 unofficial quantize model)☆11Aug 14, 2024Updated last year
- FMS Model Optimizer is a framework for developing reduced precision neural network models.☆21Jun 24, 2026Updated 3 weeks ago