attentionmech / tensorlensLinks
aesthetic tensor visualiser
☆24Updated 3 months ago
Alternatives and similar repositories for tensorlens
Users that are interested in tensorlens are comparing it to the libraries listed below
Sorting:
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆83Updated 3 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆103Updated 5 months ago
- rl from zero pretrain, can it be done? we'll see.☆66Updated 2 weeks ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆68Updated 3 months ago
- look how they massacred my boy☆63Updated 9 months ago
- An introduction to LLM Sampling☆79Updated 7 months ago
- ☆27Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 6 months ago
- Collection of autoregressive model implementation☆86Updated 3 months ago
- explore token trajectory trees on instruct and base models☆134Updated 2 months ago
- Lego for GRPO☆28Updated 2 months ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆62Updated 9 months ago
- Simple repository for training small reasoning models☆32Updated 6 months ago
- ☆61Updated last year
- Entropy Based Sampling and Parallel CoT Decoding☆17Updated 9 months ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆94Updated last week
- Simple GRPO scripts and configurations.☆59Updated 6 months ago
- Compiling useful links, papers, benchmarks, ideas, etc.☆45Updated 4 months ago
- Train your own SOTA deductive reasoning model☆103Updated 5 months ago
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆45Updated 3 months ago
- train entropix like a champ!☆19Updated 9 months ago
- alternative way to calculating self attention☆18Updated last year
- NanoGPT (124M) quality in 2.67B tokens☆28Updated last month
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆81Updated this week
- ☆55Updated 5 months ago
- Pokedex for LLMs☆13Updated 3 months ago
- ☆38Updated last year
- Low memory full parameter finetuning of LLMs☆52Updated 2 weeks ago
- smolLM with Entropix sampler on pytorch☆150Updated 9 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆56Updated last year