austinsilveria / tricksy
Fast approximate inference on a single GPU with sparsity aware offloading
☆38Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for tricksy
- ☆38Updated this week
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆19Updated 9 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated 10 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 8 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated 7 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated 9 months ago
- ☆64Updated 5 months ago
- Scripts to create your own moe models using mlx☆86Updated 8 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- Data preparation code for CrystalCoder 7B LLM☆42Updated 6 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆55Updated 2 months ago
- entropix style sampling + GUI☆25Updated last week
- LLM reads a paper and produce a working prototype☆33Updated this week
- ☆52Updated 5 months ago
- QLoRA for Masked Language Modeling☆20Updated last year
- Finetune any model on HF in less than 30 seconds☆56Updated this week
- Routing on Random Forest (RoRF)☆82Updated last month
- Collection of autoregressive model implementation☆66Updated this week
- BH hackathon☆14Updated 7 months ago
- ☆37Updated 11 months ago
- ☆103Updated 7 months ago
- An introduction to LLM Sampling☆18Updated this week
- Simple examples using Argilla tools to build AI☆38Updated this week
- Cerule - A Tiny Mighty Vision Model☆67Updated 2 months ago
- ☆22Updated last year
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆51Updated last week
- ☆72Updated last year
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆20Updated 4 months ago
- ☆116Updated 2 months ago
- Let's create synthetic textbooks together :)☆70Updated 9 months ago