Simple Transformer in Jax
☆143Jun 22, 2024Updated last year
Alternatives and similar repositories for simple_transformer
Users that are interested in simple_transformer are comparing it to the libraries listed below
Sorting:
- ☆40Jul 26, 2024Updated last year
- Entropy Based Sampling and Parallel CoT Decoding☆3,434Nov 13, 2024Updated last year
- Jax like function transformation engine but micro, microjax☆34Oct 25, 2024Updated last year
- Training Models Daily☆16Dec 19, 2023Updated 2 years ago
- Training code for Sparse Autoencoders on Embedding models☆39Feb 27, 2025Updated last year
- smolLM with Entropix sampler on pytorch☆149Oct 31, 2024Updated last year
- An implementation of the Llama architecture, to instruct and delight☆21May 31, 2025Updated 9 months ago
- A graph visualization of attention☆57May 20, 2025Updated 9 months ago
- gzip Predicts Data-dependent Scaling Laws☆34May 28, 2024Updated last year
- Frechet inception distance (FID) evaluation in JAX☆14May 28, 2024Updated last year
- ☆93Jul 5, 2024Updated last year
- utilities for batched llm calls with retries☆46Feb 26, 2026Updated last week
- Build your own visual reasoning model☆419Jan 13, 2026Updated last month
- ☆292Jul 15, 2024Updated last year
- smol models are fun too☆93Nov 9, 2024Updated last year
- DeMo: Decoupled Momentum Optimization☆198Dec 2, 2024Updated last year
- An introduction to LLM Sampling☆80Dec 15, 2024Updated last year
- Sparsify transformers with SAEs and transcoders☆699Updated this week
- supporting pytorch FSDP for optimizers☆84Dec 8, 2024Updated last year
- ☆14Apr 16, 2025Updated 10 months ago
- ☆12Jun 2, 2023Updated 2 years ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆133Feb 21, 2026Updated last week
- Plotting (entropy, varentropy) for small LMs☆99May 20, 2025Updated 9 months ago
- High Quality Resources on GPU Programming/Architecture☆593Jul 26, 2024Updated last year
- Automatically annotates YOLO dataset using Moondream visual model☆20Aug 24, 2025Updated 6 months ago
- Minimal Implimentation of VCRec (2024) for collapse provention.☆18Jan 28, 2025Updated last year
- ☆27Jul 9, 2024Updated last year
- Ultra low overhead NVIDIA GPU telemetry plugin for telegraf with memory temperature readings.☆63Jul 8, 2024Updated last year
- Reasoning Computers. Lambda Calculus, Fully Differentiable. Also Neural Stacks, Queues, Arrays, Lists, Trees, and Latches.☆285Nov 3, 2024Updated last year
- Training hybrid models for dummies.☆29Nov 1, 2025Updated 4 months ago
- ☆34Sep 10, 2024Updated last year
- Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.☆22Jan 16, 2023Updated 3 years ago
- Modify Entropy Based Sampling to work with Mac Silicon via MLX☆49Nov 6, 2024Updated last year
- ☆33Nov 4, 2024Updated last year
- WIP☆94Aug 13, 2024Updated last year
- An automated tool for discovering insights from research papaer corpora☆137Jun 8, 2024Updated last year
- Our library for RL environments + evals☆3,869Updated this week
- ☆19Dec 4, 2025Updated 3 months ago
- Simple orchestration for EC2 spot containers☆19Sep 27, 2024Updated last year