WebGPU LLM inference tuned by hand
☆153Jun 24, 2023Updated 3 years ago
Alternatives and similar repositories for token-hawk
Users that are interested in token-hawk are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆37Jun 6, 2023Updated 3 years ago
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆45Jun 13, 2023Updated 3 years ago
- A guidance language for controlling large language models.☆41Jun 9, 2023Updated 3 years ago
- ggml implementation of BERT☆505Feb 23, 2024Updated 2 years ago
- A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenci…☆313Jan 31, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆42Aug 2, 2023Updated 3 years ago
- An embedded virtual file system for games and other projects☆15Jul 14, 2025Updated last year
- Suno AI's Bark model in C/C++ for fast text-to-speech generation☆869Nov 16, 2024Updated last year
- Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)☆572Aug 8, 2023Updated 3 years ago
- ☆11Oct 11, 2023Updated 3 years ago
- C++ implementation for 💫StarCoder☆460Sep 9, 2023Updated 3 years ago
- various experiments for scaling inference time compute with small reasoning models☆17Jan 16, 2025Updated last year
- Simple script to re-rank images using OpenAI's CLIP https://github.com/openai/CLIP.☆15May 3, 2021Updated 5 years ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆142Oct 17, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,886Jan 28, 2024Updated 2 years ago
- INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model☆1,584Mar 23, 2025Updated last year
- A minimal Python re-implementation of the A* with seed heuristic for exact global alignment (edit distance) in near-linear time☆22Nov 30, 2024Updated last year
- ☆453Oct 15, 2023Updated 2 years ago
- LLM-based code completion engine☆192Jan 23, 2025Updated last year
- [Poster; ICLR 2026] [Oral; Neurips OPT2024] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers☆16Apr 15, 2026Updated 5 months ago
- A Swift package for interacting with selenium and undetected-chromedriver through python by using PythonKit.☆13Jun 21, 2025Updated last year
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia☆42Mar 13, 2023Updated 3 years ago
- ☆13May 25, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Plug n Play GBNF Compiler for llama.cpp☆33Nov 8, 2023Updated 2 years ago
- A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files☆53Jul 30, 2024Updated 2 years ago
- A distributed execution framework built upon lunatic.☆16Jan 19, 2024Updated 2 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers☆427Dec 20, 2023Updated 2 years ago
- Builds Dawn on Linux and macOS as one single easier-to-use library☆29Dec 5, 2021Updated 4 years ago
- ☆16Dec 16, 2024Updated last year
- Embeddings focused small version of Llama NLP model☆108Apr 27, 2023Updated 3 years ago
- Falcon LLM ggml framework with CPU and GPU support☆250Jul 2, 2026Updated 3 months ago
- A fast batching API to serve LLM models☆188Apr 26, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆23Apr 15, 2026Updated 5 months ago
- Let's make sand talk☆586Oct 17, 2023Updated 2 years ago
- a browser gui for nvidia smi☆21Mar 17, 2025Updated last year
- Rust bindings for CTranslate2☆14Jun 21, 2023Updated 3 years ago
- Scripts to create your own moe models using mlx☆93Feb 26, 2024Updated 2 years ago
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆43Jun 20, 2025Updated last year
- HuggingChat like UI in Gradio☆69May 23, 2023Updated 3 years ago