kayvr / token-hawkLinks
WebGPU LLM inference tuned by hand
☆150Updated 2 years ago
Alternatives and similar repositories for token-hawk
Users that are interested in token-hawk are comparing it to the libraries listed below
Sorting:
- Extend the original llama.cpp repo to support redpajama model.☆118Updated last year
- An implementation of bucketMul LLM inference☆223Updated last year
- LLM-based code completion engine☆191Updated 8 months ago
- SoTA Transformers with C-backend for fast inference on your CPU.☆307Updated last year
- LLaVA server (llama.cpp).☆182Updated last year
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆140Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated 2 years ago
- Run inference on replit-3B code instruct model using CPU☆158Updated 2 years ago
- Command-line script for inferencing from models such as MPT-7B-Chat☆100Updated 2 years ago
- Full finetuning of large language models without large memory requirements☆93Updated 2 weeks ago
- Falcon LLM ggml framework with CPU and GPU support☆247Updated last year
- Tensor library for machine learning☆273Updated 2 years ago
- Run GGML models with Kubernetes.☆173Updated last year
- Python bindings for ggml☆146Updated last year
- GRDN.AI app for garden optimization☆70Updated last year
- Drop in replacement for OpenAI, but with Open models.☆153Updated 2 years ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU☆104Updated 2 years ago
- ☆112Updated last year
- ☆40Updated 2 years ago
- Command-line script for inferencing from models such as falcon-7b-instruct☆74Updated 2 years ago
- Embeddings focused small version of Llama NLP model☆105Updated 2 years ago
- Modified Stanford-Alpaca Trainer for Training Replit's Code Model☆41Updated 2 years ago
- Mistral7B playing DOOM☆137Updated last year
- inference code for mixtral-8x7b-32kseqlen☆101Updated last year
- GPU accelerated client-side embeddings for vector search, RAG etc.☆65Updated last year
- JS tokenizer for LLaMA 1 and 2☆359Updated last year
- tinygrad port of the RWKV large language model.☆45Updated 7 months ago
- ☆162Updated 2 months ago
- C++ implementation for 💫StarCoder☆455Updated 2 years ago