kayvr / token-hawkLinks
WebGPU LLM inference tuned by hand
☆150Updated last year
Alternatives and similar repositories for token-hawk
Users that are interested in token-hawk are comparing it to the libraries listed below
Sorting:
- Extend the original llama.cpp repo to support redpajama model.☆117Updated 9 months ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆122Updated last year
- Mistral7B playing DOOM☆131Updated 10 months ago
- LLaVA server (llama.cpp).☆179Updated last year
- Full finetuning of large language models without large memory requirements☆93Updated last year
- Command-line script for inferencing from models such as falcon-7b-instruct☆74Updated 2 years ago
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆137Updated 10 months ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆101Updated last year
- GRDN.AI app for garden optimization☆70Updated last year
- Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU☆102Updated last year
- tinygrad port of the RWKV large language model.☆45Updated 2 months ago
- An implementation of bucketMul LLM inference☆217Updated 11 months ago
- Falcon LLM ggml framework with CPU and GPU support☆245Updated last year
- Python bindings for ggml☆140Updated 9 months ago
- Preprint: Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning☆28Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆109Updated last year
- The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…☆121Updated 2 years ago
- Fast parallel LLM inference for MLX☆189Updated 10 months ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆66Updated last year
- C++ implementation for 💫StarCoder☆452Updated last year
- LLM-based code completion engine☆189Updated 4 months ago
- Tiny inference-only implementation of LLaMA☆93Updated last year
- Inference Llama 2 in one file of pure JavaScript(HTML)☆33Updated 2 weeks ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- ☆40Updated 2 years ago
- Run GGML models with Kubernetes.☆172Updated last year
- This repository explains and provides examples for "concept anchoring" in GPT4.☆72Updated last year
- Modified Stanford-Alpaca Trainer for Training Replit's Code Model☆40Updated 2 years ago
- Generates grammer files from typescript for LLM generation☆38Updated last year
- Tensor library for machine learning☆275Updated 2 years ago