catid / dataloaderLinks
High-performance tokenized language data-loader for Python C++ extension
☆13Updated last year
Alternatives and similar repositories for dataloader
Users that are interested in dataloader are comparing it to the libraries listed below
Sorting:
- JAX/Flax implementation of the Hyena Hierarchy☆34Updated 2 years ago
- Implementation of a holodeck, written in Pytorch☆18Updated 2 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- Write your code as tree-like expressions, then transform it☆21Updated last year
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆49Updated 3 years ago
- RWKV model implementation☆38Updated 2 years ago
- ☆60Updated 3 years ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- ☆13Updated 5 months ago
- ☆31Updated last year
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆45Updated 2 years ago
- Utilities for Training Very Large Models☆58Updated last year
- List of awesome JAX resources☆13Updated 2 years ago
- ☆18Updated last year
- A programming language for formal/informal computation.☆41Updated 3 months ago
- Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch☆12Updated 3 years ago
- Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"☆29Updated 5 years ago
- Implementations of growing and pruning in neural networks☆22Updated 2 years ago
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆32Updated 2 years ago
- Flax Image Models - State-of-the-art pre-trained vision backbones for Flax.☆23Updated 5 months ago
- HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]☆14Updated 2 years ago
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆14Updated last year
- AdaCat☆49Updated 3 years ago
- A stateful pytree library for training neural networks.☆22Updated 2 months ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆50Updated 3 years ago
- Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012☆49Updated 3 years ago
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆16Updated 4 years ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆89Updated last year
- JAX implementation of Graph Attention Networks☆13Updated 3 years ago
- ☆31Updated this week