WebGPU LLM inference tuned by hand
☆150Jun 24, 2023Updated 3 years ago
Alternatives and similar repositories for token-hawk
Users that are interested in token-hawk are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆37Jun 6, 2023Updated 3 years ago
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆45Jun 13, 2023Updated 3 years ago
- Inference Llama 2 in one file of pure JavaScript(HTML)☆36May 20, 2025Updated last year
- A guidance language for controlling large language models.☆43Jun 9, 2023Updated 3 years ago
- ggml implementation of BERT☆501Feb 23, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Erudito: Easy API/CLI to ask questions about your documentation☆98Nov 6, 2023Updated 2 years ago
- A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenci…☆312Jan 31, 2024Updated 2 years ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆40Aug 2, 2023Updated 2 years ago
- An embedded virtual file system for games and other projects☆15Jul 14, 2025Updated last year
- Suno AI's Bark model in C/C++ for fast text-to-speech generation☆866Nov 16, 2024Updated last year
- Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)☆573Aug 8, 2023Updated 2 years ago
- ☆11Oct 11, 2023Updated 2 years ago
- C++ implementation for 💫StarCoder☆459Sep 9, 2023Updated 2 years ago
- various experiments for scaling inference time compute with small reasoning models☆17Jan 16, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Efficient 3bit/4bit quantization of LLaMA models☆18May 18, 2023Updated 3 years ago
- A fork of textgen that kept some things like Exllama and old GPTQ.☆22Aug 20, 2024Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆143Oct 17, 2023Updated 2 years ago
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,884Jan 28, 2024Updated 2 years ago
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆162Feb 9, 2024Updated 2 years ago
- A Next.js chatbot app demonstrating seamless integration with window.ai.☆15Jun 25, 2023Updated 3 years ago
- INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model☆1,579Mar 23, 2025Updated last year
- A minimal Python re-implementation of the A* with seed heuristic for exact global alignment (edit distance) in near-linear time☆22Nov 30, 2024Updated last year
- ☆456Oct 15, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- LLM-based code completion engine☆194Jan 23, 2025Updated last year
- A Swift package for interacting with selenium and undetected-chromedriver through python by using PythonKit.☆13Jun 21, 2025Updated last year
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia☆42Mar 13, 2023Updated 3 years ago
- ☆14May 25, 2023Updated 3 years ago
- Download full or partial git-lfs repos without temporarily using 2x disk space☆32Oct 13, 2023Updated 2 years ago
- Plug n Play GBNF Compiler for llama.cpp☆33Nov 8, 2023Updated 2 years ago
- A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files☆52Jul 30, 2024Updated last year
- ☆15Jun 5, 2023Updated 3 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers☆426Dec 20, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Embeddings focused small version of Llama NLP model☆108Apr 27, 2023Updated 3 years ago
- Falcon LLM ggml framework with CPU and GPU support☆250Jul 2, 2026Updated 3 weeks ago
- A repo to hold some simple experiments☆14May 4, 2022Updated 4 years ago
- Optimization algorithm which fits a ResNet to CIFAR-10 5x faster than SGD / Adam (with terrible generalization)☆14Oct 20, 2023Updated 2 years ago
- Let's make sand talk☆590Oct 17, 2023Updated 2 years ago
- ☆21May 24, 2023Updated 3 years ago
- https://hf.co/hexgrad/Kokoro-82M☆14Jan 14, 2026Updated 6 months ago