austinsilveria / tricksy
Fast approximate inference on a single GPU with sparsity aware offloading
☆38Updated last year
Alternatives and similar repositories for tricksy:
Users that are interested in tricksy are comparing it to the libraries listed below
- ☆46Updated 2 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated 9 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆70Updated last year
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆21Updated last month
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- Easy to use, High Performant Knowledge Distillation for LLMs☆38Updated last week
- Cerule - A Tiny Mighty Vision Model☆67Updated 4 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated 10 months ago
- entropix style sampling + GUI☆25Updated 2 months ago
- Data preparation code for CrystalCoder 7B LLM☆43Updated 8 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- ☆96Updated 4 months ago
- ☆65Updated 7 months ago
- ☆48Updated last year
- Very minimal (and stateless) agent framework☆41Updated this week
- ☆20Updated last year
- ☆35Updated last year
- Routing on Random Forest (RoRF)☆98Updated 3 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 6 months ago
- Score LLM pretraining data with classifiers☆55Updated last year
- BH hackathon☆14Updated 9 months ago
- Scripts to create your own moe models using mlx☆85Updated 10 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆58Updated 4 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 10 months ago
- ☆24Updated last year
- Modified Stanford-Alpaca Trainer for Training Replit's Code Model☆40Updated last year
- Just a bunch of benchmark logs for different LLMs☆116Updated 5 months ago
- ☆22Updated last year
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆22Updated 6 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆62Updated 2 months ago