GLM-5.3-Flash adaptation + offload perf patches for FreeToken v0.1.2 (17.8→36.7 tok/s on one RTX PRO 6000)
☆21Oct 2, 2026Updated last month
Alternatives and similar repositories for freetoken-ox-boost
Users that are interested in freetoken-ox-boost are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆23Dec 7, 2023Updated 2 years ago
- Memory-bounded compressed sparse attention via streaming top-k. Triton kernels for the DeepSeek-V4 lightning indexer. 32x regime extensio…☆27May 5, 2026Updated 6 months ago
- ☆28Mar 31, 2026Updated 7 months ago
- A fast, provider-independent coding agent for the terminal, written in Rust.☆27Updated this week
- HUD for CI activity on `pytorch/pytorch`, provides a top level view for jobs to easily discern regressions☆14Feb 26, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Generate fictional characters with randomized appearance, personality traits & conflicts.☆10Jul 31, 2017Updated 9 years ago
- A concise collection of runnable .NET sample apps that demonstrate practical integration with GitHub Models and Azure AI Foundry. include…☆20Nov 27, 2025Updated 11 months ago
- A Triton JIT runtime and ffi provider in C++☆41Nov 4, 2026Updated 2 weeks ago
- Local-first agent that drives Claude Code and Codex over ACP. Desktop app, git-URL plugins, A2A 1.0. MIT.☆18Updated this week
- Lith Studios Ghost Hunt☆10Oct 19, 2024Updated 2 years ago
- ☆15Jun 26, 2024Updated 2 years ago
- A FastAPI and MCP server connected to Supabase table for managing, testing, and programmatically accessing LLM System Instructions, Syste…☆14Oct 22, 2026Updated 3 weeks ago
- I Ran Qwen 3.8 27B on Just 4GB VRAM! (FreeToken Tutorial) - Edge-native MoE serving engine for local LLMs on low VRAM GPUs☆16Aug 23, 2026Updated 2 months ago
- DeepTrace: A lightweight, scalable real-time diagnostic and analysis tool for distributed training tasks.☆18Nov 4, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- DeepSeek2API/Qwen2API. Compatible with OpenAI Chat Completions/Responses & Anthropic Messages. Supports streaming, tool calls, attachment…☆15Sep 10, 2026Updated 2 months ago
- Repository for update, release, Python trainer kit for Trainer Studio under Apache 2.0 License☆15Apr 1, 2025Updated last year
- ☆19Oct 10, 2026Updated last month
- [DAC2024] A Holistic Functionalization Approach to Optimizing Imperative Tensor Programs in Deep Learning☆15Jan 13, 2024Updated 2 years ago
- 🔥 Auto-updated A curated list of the most starred AI agent-related repositories on GitHub.☆25Updated this week
- Localix Terminal: the terminal for you and your coding agents. Project sessions that come back as you left them; Claude Code, Codex or an…☆24Updated this week
- Computational storyteller based on an extended Jason Multi Agent Simulation Architecture.☆17Jun 7, 2021Updated 5 years ago
- Uma IA VTuber que mora no seu PC. Fala, escuta, lembra — e nada sai da sua máquina.☆32Aug 28, 2026Updated 2 months ago
- A high-performance Python extension for fast element-wise dictionary operations.☆10Aug 13, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- a simple, web-based (multi-platform) mp3 player☆10Dec 11, 2018Updated 7 years ago
- ☆68Feb 24, 2026Updated 8 months ago
- Self-Knowledge Guided Retrieval Augmentation for Large Language Models (EMNLP Findings 2023)☆27Dec 8, 2023Updated 2 years ago
- Dan Bricklin's wikiCalc☆11Dec 1, 2010Updated 15 years ago
- ☆25Jun 11, 2026Updated 5 months ago
- Anthropic Rust SDK: Supports streaming and async☆12Jan 5, 2026Updated 10 months ago
- Making learning fun + Help in learning through GenAi☆17Jan 31, 2024Updated 2 years ago
- A demonstration of integrating FastAPI with Ollama, featuring streaming, formatted, and complete JSON responses from AI models. Learn how…☆22Aug 23, 2024Updated 2 years ago
- ☆22Apr 22, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- RucRut is an AI-powered recruitment system that streamlines the hiring process by automatically generating interview questions, evaluatin…☆20Sep 5, 2024Updated 2 years ago
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated last year
- ☆61Mar 15, 2025Updated last year
- Sync engine for new-api. Discovers, prices, tests, and syncs AI models across 40+ providers into the core backend.☆24Updated this week
- Open-source AI character creator & roleplay chat studio — production-ready Next.js SaaS that generates custom AI character portraits and …☆28Oct 22, 2026Updated 3 weeks ago
- ☆14Apr 27, 2025Updated last year
- an auto-sleeping and -waking framework around llama.cpp☆13Feb 8, 2025Updated last year
Are these results useful?