catid / dataloaderLinks
High-performance tokenized language data-loader for Python C++ extension
☆13Updated 10 months ago
Alternatives and similar repositories for dataloader
Users that are interested in dataloader are comparing it to the libraries listed below
Sorting:
- Simplifying parsing of large jsonline files in NLP Workflows☆12Updated 3 years ago
- ☆18Updated last year
- Repo for solving arc problems with an Neural Cellular Automata☆15Updated 2 weeks ago
- Minimum Description Length probing for neural network representations☆19Updated 4 months ago
- ☆11Updated last year
- Implementation of a holodeck, written in Pytorch☆18Updated last year
- Implementation of Spectral State Space Models☆16Updated last year
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆31Updated last year
- ☆11Updated 3 months ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- Write your code as tree-like expressions, then transform it☆21Updated last year
- Training hybrid models for dummies.☆21Updated 4 months ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch☆12Updated 3 years ago
- A small python library to run iterators in a separate process☆10Updated last year
- Implementations of growing and pruning in neural networks☆22Updated last year
- code for paper "Accessing higher dimensions for unsupervised word translation"☆21Updated last year
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆16Updated 3 years ago
- Pyterator helps you write fluent interfaces for collections☆9Updated 2 years ago
- JAX/Flax implementation of the Hyena Hierarchy☆34Updated 2 years ago
- 🧮 Algebraic Positional Encodings.☆13Updated 4 months ago
- Isomorphisms of quiver representations applied to neural networks.☆16Updated 10 months ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- Easily serialize dataclasses to and from tensors (PyTorch, NumPy)☆18Updated 4 years ago
- Code and data for paper "(How) do Language Models Track State?"☆14Updated 2 months ago
- ☆16Updated last year
- Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]☆19Updated last week
- Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch☆25Updated 4 months ago
- List of awesome JAX resources☆13Updated 2 years ago
- A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.☆16Updated 7 months ago