davidar / eigenGPTLinks
Minimal C++ implementation of GPT2
☆40Updated 2 years ago
Alternatives and similar repositories for eigenGPT
Users that are interested in eigenGPT are comparing it to the libraries listed below
Sorting:
- OMNI: Open-endedness via Models of human Notions of Interestingness☆57Updated 10 months ago
- MACTA: A Multi-agent Reinforcement Learning Approach for Cache Timing Attacks and Detection☆46Updated 2 years ago
- ☆53Updated last year
- Exploration into the Firefly algorithm in Pytorch☆41Updated 10 months ago
- RWKV in nanoGPT style☆195Updated last year
- FlexAttention w/ FlashAttention3 Support☆27Updated last year
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆73Updated last year
- A lightweight PyTorch implementation of the Transformer-XL architecture proposed by Dai et al. (2019)☆37Updated 2 years ago
- Token Omission Via Attention☆128Updated last year
- LLM training in simple, raw C/CUDA☆18Updated last year
- Official Implementation of NeurIPS'23 Paper "Cross-Episodic Curriculum for Transformer Agents"☆31Updated 2 years ago
- Efficient World Models with Context-Aware Tokenization. ICML 2024☆114Updated last year
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆38Updated 6 months ago
- A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.☆125Updated 3 months ago
- Efficiently send large arrays across machines☆17Updated last year
- Make triton easier☆49Updated last year
- throwaway GPT inference☆141Updated last year
- ☆32Updated last year
- Utilities for Training Very Large Models☆58Updated last year
- A really tiny autograd engine☆96Updated 6 months ago
- Memoria is a human-inspired memory architecture for neural networks.☆79Updated last year
- Multi-Layer Key-Value sharing experiments on Pythia models☆34Updated last year
- Code for "Meta Learning Backpropagation And Improving It" @ NeurIPS 2021 https://arxiv.org/abs/2012.14905☆33Updated 3 years ago
- Clover: Quantized 4-bit Linear Algebra Library☆114Updated 7 years ago
- Repo to reproduce the First-Explore paper results☆38Updated 11 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Updated last year
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆43Updated 2 years ago
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆98Updated last year
- ☆91Updated last year
- Standalone commandline CLI tool for compiling Triton kernels☆20Updated last year