joennlae / tensorli
Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).
☆250Updated last year
Alternatives and similar repositories for tensorli:
Users that are interested in tensorli are comparing it to the libraries listed below
- ☆237Updated 10 months ago
- Algebraic enhancements for GEMM & AI accelerators☆263Updated this week
- A BERT that you can train on a (gaming) laptop.☆210Updated last year
- Autograd to GPT-2 completely from scratch☆108Updated last week
- Run and explore Llama models locally with minimal dependencies on CPU☆190Updated 3 months ago
- ☆250Updated last year
- A pure NumPy implementation of Mamba.☆219Updated 6 months ago
- Generate Cool-Looking Mazes and Animations Illustrating the A* Pathfinding Algorithm☆175Updated 5 months ago
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆276Updated last month
- The Fast Vector Similarity Library is designed to provide efficient computation of various similarity measures between vectors.☆370Updated 4 months ago
- A Detailed Introduction to My Favorite Statistical Measure, Hoeffding's D☆97Updated 11 months ago
- DiscoGrad - automatically differentiate across conditional branches in C++ programs☆203Updated 4 months ago
- A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…☆279Updated last month
- Radient turns many data types (not just text) into vectors for similarity search, RAG, regression analysis, and more.☆273Updated 3 weeks ago
- This is a numpy implementation of the Skip-gram algorithm described in Mikolov et al's Word2Vec paper. It is intended for didactic purpos…☆35Updated last year
- Automated, smooth, N'th order derivatives of non-uniformly sampled time series data☆225Updated 3 months ago
- Revealing example of self-attention, the building block of transformer AI models☆130Updated last year
- This is a python implementation for stitching images.☆234Updated 3 months ago
- Sequential Logic☆109Updated this week
- A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…☆605Updated 2 months ago
- An implementation of bucketMul LLM inference☆215Updated 6 months ago
- Dead Simple LLM Abliteration☆130Updated 2 months ago
- ☆180Updated 5 months ago
- a small code base for training large models☆283Updated last month
- High-Performance Klong array language in Python.☆289Updated last month
- throwaway GPT inference☆140Updated 7 months ago
- Visualize the intermediate output of Mistral 7B☆334Updated last week
- Lamport's Bakery Algorithm Demonstrated in Python☆96Updated last year
- ☆163Updated 8 months ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆216Updated last month