catid / dataloader
High-performance tokenized language data-loader for Python C++ extension
☆12Updated 7 months ago
Alternatives and similar repositories for dataloader:
Users that are interested in dataloader are comparing it to the libraries listed below
- Simplifying parsing of large jsonline files in NLP Workflows☆12Updated 3 years ago
- Implementation of Spectral State Space Models☆16Updated last year
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- Implementation of a holodeck, written in Pytorch☆17Updated last year
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- Minimum Description Length probing for neural network representations☆19Updated last month
- ☆11Updated 9 months ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 9 months ago
- Training hybrid models for dummies.☆20Updated last month
- HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]☆14Updated last year
- JAX/Flax implementation of the Hyena Hierarchy☆33Updated last year
- Easily serialize dataclasses to and from tensors (PyTorch, NumPy)☆18Updated 3 years ago
- ☆18Updated 10 months ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆23Updated 3 weeks ago
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆15Updated 3 years ago
- A sample pattern for running CI tests on Modal☆14Updated 5 months ago
- JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"☆19Updated last year
- Write your code as tree-like expressions, then transform it☆21Updated last year
- Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch☆12Updated 3 years ago
- ☆33Updated last year
- ☆18Updated 9 months ago
- Code for the paper: https://arxiv.org/pdf/2309.06979.pdf☆19Updated 7 months ago
- ☆13Updated 2 years ago
- See https://github.com/cuda-mode/triton-index/ instead!☆11Updated 9 months ago
- ☆21Updated 2 months ago
- A framework for implementing equivariant DL☆10Updated 3 years ago
- A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.☆16Updated 4 months ago
- Utilities for PyTorch distributed☆23Updated this week
- RWKV model implementation☆37Updated last year
- A JAX nn library☆21Updated this week