EthanBnntt / tinygrad-vit
A minimalist implementation of the ViT (Vision Transformer) model, using tinygrad
☆12Updated 8 months ago
Alternatives and similar repositories for tinygrad-vit
Users that are interested in tinygrad-vit are comparing it to the libraries listed below
Sorting:
- ☆43Updated 3 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆47Updated this week
- NLP with Rust for Python 🦀🐍☆62Updated 11 months ago
- ☆20Updated last year
- Simple GRPO scripts and configurations.☆58Updated 3 months ago
- Python library to use Pleias-RAG models☆46Updated last week
- lossily compress representation vectors using product quantization☆52Updated 3 weeks ago
- ☆18Updated 7 months ago
- ☆48Updated 6 months ago
- A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.☆22Updated last month
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆52Updated 3 months ago
- Pre-train Static Word Embeddings☆59Updated last month
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 6 months ago
- The official evaluation suite and dynamic data release for MixEval.☆11Updated 7 months ago
- Using modal.com to process FineWeb-edu data☆20Updated last month
- Lego for GRPO☆28Updated last month
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- ☆28Updated 6 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆32Updated 3 weeks ago
- A list of language models with permissive licenses such as MIT or Apache 2.0☆24Updated 2 months ago
- Training hybrid models for dummies.☆21Updated 3 months ago
- Set of scripts to finetune LLMs☆37Updated last year
- ☆19Updated 6 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆35Updated last year
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated last year
- ☆56Updated this week
- ☆22Updated 11 months ago
- ☆27Updated 8 months ago
- Simple repository for training small reasoning models☆27Updated 3 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year