catid / dataloaderLinks
High-performance tokenized language data-loader for Python C++ extension
☆13Updated 11 months ago
Alternatives and similar repositories for dataloader
Users that are interested in dataloader are comparing it to the libraries listed below
Sorting:
- Simplifying parsing of large jsonline files in NLP Workflows☆12Updated 3 years ago
- ☆18Updated last year
- Easily serialize dataclasses to and from tensors (PyTorch, NumPy)☆18Updated 4 years ago
- Implementation of a holodeck, written in Pytorch☆18Updated last year
- Minimum Description Length probing for neural network representations☆18Updated 4 months ago
- ☆11Updated last year
- Implementation of Spectral State Space Models☆16Updated last year
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆16Updated 3 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]☆14Updated last year
- Repo for solving arc problems with an Neural Cellular Automata☆16Updated last month
- ☆18Updated 3 weeks ago
- Flax Image Models - State-of-the-art pre-trained vision backbones for Flax.☆20Updated 3 weeks ago
- ☆11Updated 4 months ago
- Training hybrid models for dummies.☆23Updated 5 months ago
- See https://github.com/cuda-mode/triton-index/ instead!☆11Updated last year
- Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch☆12Updated 3 years ago
- JAX/Flax implementation of the Hyena Hierarchy☆34Updated 2 years ago
- code for paper "Accessing higher dimensions for unsupervised word translation"☆21Updated last year
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- Analogous Safe-state Exploration (ASE) is an algorithm for provably safe and optimal exploration in MDPs with unknown, stochastic dynamic…☆11Updated 4 years ago
- A sample pattern for running CI tests on Modal☆18Updated 2 months ago
- A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.☆16Updated 7 months ago
- Rust bindings for CTranslate2☆14Updated 2 years ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆24Updated 3 weeks ago
- A framework for implementing equivariant DL☆10Updated 4 years ago
- Code for our ICLR Trustworthy ML 2020 workshop paper "Improved Image Wasserstein Attacks and Defenses"☆14Updated 5 years ago
- Describe the format of image/text datasets☆11Updated 3 years ago
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆31Updated last year