kolinko / effort
An implementation of bucketMul LLM inference
☆214Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for effort
- Fast parallel LLM inference for MLX☆146Updated 4 months ago
- Visualize the intermediate output of Mistral 7B☆311Updated 8 months ago
- run paligemma in real time☆122Updated 5 months ago
- Mistral7B playing DOOM☆122Updated 3 months ago
- Stateful load balancer custom-tailored for llama.cpp☆556Updated this week
- WebGPU LLM inference tuned by hand☆146Updated last year
- Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …☆192Updated 5 months ago
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆271Updated this week
- ☆235Updated 7 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated 10 months ago
- Full finetuning of large language models without large memory requirements☆93Updated 10 months ago
- Stop messing around with finicky sampling parameters and just use DRµGS!☆317Updated 5 months ago
- Run GGML models with Kubernetes.☆173Updated 10 months ago
- Tiny inference-only implementation of LLaMA☆91Updated 7 months ago
- Official codebase for the paper "Beyond A* Better Planning with Transformers via Search Dynamics Bootstrapping".☆313Updated 4 months ago
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces☆131Updated 4 months ago
- GGUF implementation in C as a library and a tools CLI program☆242Updated 4 months ago
- 1.58 Bit LLM on Apple Silicon using MLX☆134Updated 5 months ago
- a small code base for training large models☆264Updated last week
- LLaVA server (llama.cpp).☆177Updated last year
- ☆223Updated 2 weeks ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆53Updated this week
- ☆84Updated last month
- a curated list of data for reasoning ai☆111Updated 3 months ago
- DiscoGrad - automatically differentiate across conditional branches in C++ programs☆204Updated last month
- A BERT that you can train on a (gaming) laptop.☆212Updated last year
- scalable and robust tree-based speculative decoding algorithm☆313Updated 2 months ago
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated 3 weeks ago
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆249Updated 11 months ago
- ☆113Updated last week