catid / dataloader
High-performance tokenized language data-loader for Python C++ extension
☆13Updated 9 months ago
Alternatives and similar repositories for dataloader
Users that are interested in dataloader are comparing it to the libraries listed below
Sorting:
- Simplifying parsing of large jsonline files in NLP Workflows☆12Updated 3 years ago
- Minimum Description Length probing for neural network representations☆19Updated 3 months ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- ☆15Updated 3 months ago
- ☆18Updated last year
- ☆11Updated 11 months ago
- Implementation of Spectral State Space Models☆16Updated last year
- HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]☆14Updated last year
- Flax Image Models - State-of-the-art pre-trained vision backbones for Flax.☆19Updated last year
- Implementation of a holodeck, written in Pytorch☆17Updated last year
- Training hybrid models for dummies.☆21Updated 3 months ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch☆12Updated 3 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 11 months ago
- ☆14Updated last month
- JAX/Flax implementation of the Hyena Hierarchy☆34Updated 2 years ago
- ☆13Updated 2 months ago
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆15Updated 3 years ago
- Residual Quantization Autoencoder, used for interpreting LLMs☆12Updated 4 months ago
- Personal solutions to the Triton Puzzles☆18Updated 9 months ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆23Updated 3 weeks ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆30Updated this week
- Pyterator helps you write fluent interfaces for collections☆9Updated 2 years ago
- 🧮 Algebraic Positional Encodings.☆12Updated 4 months ago
- This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.☆14Updated 3 years ago
- Implements EvoNorms B0 and S0 as proposed in Evolving Normalization-Activation Layers.☆11Updated 5 years ago
- A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.☆16Updated 6 months ago
- Easily serialize dataclasses to and from tensors (PyTorch, NumPy)☆18Updated 4 years ago
- See https://github.com/cuda-mode/triton-index/ instead!☆11Updated last year
- code for paper "Accessing higher dimensions for unsupervised word translation"☆21Updated last year