johnmarktaylor91 / torchlens
Package for extracting and mapping the results of every single tensor operation in a PyTorch model in one line of code.
☆482Updated this week
Related projects ⓘ
Alternatives and complementary repositories for torchlens
- Puzzles for exploring transformers☆325Updated last year
- Annotated version of the Mamba paper☆457Updated 8 months ago
- For optimization algorithm research and development.☆449Updated this week
- ☆139Updated 3 months ago
- torchview: visualize pytorch models☆831Updated 3 weeks ago
- An interactive exploration of Transformer programming.☆246Updated last year
- TensorDict is a pytorch dedicated tensor container.☆840Updated this week
- Universal Tensor Operations in Einstein-Inspired Notation for Python.☆328Updated last month
- Tensors, for human consumption☆1,113Updated 3 weeks ago
- A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…☆270Updated 3 weeks ago
- ☆197Updated 4 months ago
- ☆391Updated last month
- A library to inspect and extract intermediate layers of PyTorch models.☆470Updated 2 years ago
- ViT Prisma is a mechanistic interpretability library for Vision Transformers (ViTs).☆179Updated this week
- Interactively inspect module inputs, outputs, parameters, and gradients.☆315Updated 5 months ago
- 94% on CIFAR-10 in 2.6 seconds 💨 96% in 27 seconds☆177Updated last week
- What would you do with 1000 H100s...☆903Updated 10 months ago
- ☆751Updated this week
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆325Updated last week
- Building blocks for foundation models.☆394Updated 10 months ago
- Library for Jacobian descent with PyTorch. It enables optimization of neural networks with multiple losses (e.g. multi-task learning).☆154Updated this week
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆715Updated last month
- Implementation of Diffusion Transformer (DiT) in JAX☆252Updated 5 months ago
- 🤖 A PyTorch library of curated Transformer models and their composable components☆866Updated 7 months ago
- Helpful tools and examples for working with flex-attention☆469Updated 3 weeks ago
- Named tensors with first-class dimensions for PyTorch☆322Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆516Updated this week
- Automatic gradient descent☆206Updated last year
- TensorHue is a Python library that allows you to visualize tensors right in your console, making understanding and debugging tensor conte…☆111Updated last month
- The AdEMAMix Optimizer: Better, Faster, Older.☆172Updated 2 months ago