SonicCodes / lucid-v1Links
realtime latent world model inference demo
☆49Updated last year
Alternatives and similar repositories for lucid-v1
Users that are interested in lucid-v1 are comparing it to the libraries listed below
Sorting:
- Focused on fast experimentation and simplicity☆80Updated last year
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆109Updated 10 months ago
- Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)☆34Updated 11 months ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆73Updated 9 months ago
- DeMo: Decoupled Momentum Optimization☆198Updated last year
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- look how they massacred my boy☆63Updated last year
- Video+code lecture on building nanoGPT from scratch☆68Updated last year
- ☆28Updated 3 months ago
- Cerule - A Tiny Mighty Vision Model☆68Updated 2 months ago
- smolLM with Entropix sampler on pytorch☆149Updated last year
- Simple Transformer in Jax☆142Updated last year
- working implimention of deepseek MLA☆45Updated last year
- https://hf.co/hexgrad/Kokoro-82M☆14Updated 2 weeks ago
- Collection of autoregressive model implementation☆85Updated 2 weeks ago
- σ-GPT: A New Approach to Autoregressive Models☆70Updated last year
- Plotting (entropy, varentropy) for small LMs☆99Updated 8 months ago
- a highly efficient compression algorithm for the n1 implant (neuralink's compression challenge)☆47Updated last year
- RL gym for vision language models written in JAX☆141Updated 3 months ago
- MoE training for Me and You and maybe other people☆331Updated 3 weeks ago
- ☆27Updated last year
- research impl of Native Sparse Attention (2502.11089)☆63Updated 11 months ago
- Basic world models☆30Updated 3 months ago
- High-throughput tensor loading for PyTorch☆221Updated last week
- WIP☆93Updated last year
- ☆40Updated last year
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆85Updated 5 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆103Updated last year
- ☆32Updated last year
- ☆24Updated 8 months ago