Efficient, check-pointed data loading for deep learning with massive data sets.
☆211Jun 12, 2023Updated 2 years ago
Alternatives and similar repositories for infinibatch
Users that are interested in infinibatch are comparing it to the libraries listed below
Sorting:
- ☆107Apr 15, 2021Updated 4 years ago
- int8_t and int16_t matrix multiply based on https://arxiv.org/abs/1705.01991☆74Dec 30, 2023Updated 2 years ago
- Parallelized automatic corpus collection for ASR. Forked from https://github.com/EgorLakomkin/KTSpeechCrawler☆23Mar 21, 2021Updated 4 years ago
- Language model powered proof reader for correcting contextual errors in natural language.☆24Jul 6, 2023Updated 2 years ago
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,123Apr 20, 2022Updated 3 years ago
- Configure Python functions explicitly and safely☆129Nov 18, 2024Updated last year
- The implementation of the paper "Harvesting and Refining Question-Answer Pairs for Unsupervised QA"☆33Nov 25, 2020Updated 5 years ago
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆24Jun 6, 2024Updated last year
- Based on https://github.com/fatchord/WaveRNN☆24May 3, 2020Updated 5 years ago
- High performance model preprocessing library on PyTorch☆646Mar 29, 2024Updated last year
- Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.☆135Dec 10, 2023Updated 2 years ago
- PyProf2: PyTorch Profiling tool☆82Jun 25, 2020Updated 5 years ago
- Fast Block Sparse Matrices for Pytorch☆549Jan 21, 2021Updated 5 years ago
- An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…☆433Aug 17, 2022Updated 3 years ago
- Code to support the paper "Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets"☆65Aug 31, 2021Updated 4 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32May 25, 2024Updated last year
- Cross-Lingual Machine Reading Comprehension (EMNLP 2019)☆67Nov 6, 2019Updated 6 years ago
- Pytorch library for fast transformer implementations☆1,762Mar 23, 2023Updated 2 years ago
- ☆11Oct 11, 2023Updated 2 years ago
- Colab notebooks for d2l-book☆11Dec 5, 2019Updated 6 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 2 years ago
- PyTorch implementation for PaLM: A Hybrid Parser and Language Model.☆10Jan 7, 2020Updated 6 years ago
- This is a C++ implementation of cocoapi bbox evaluation code.☆11Dec 9, 2021Updated 4 years ago
- Efficient Low-Memory Aligner☆146Jan 15, 2025Updated last year
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,248Feb 22, 2026Updated last week
- A collection of selected of models built with AllenNLP.☆25Feb 20, 2020Updated 6 years ago
- Code for EMNLP2021 paper "Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training"☆20Nov 12, 2021Updated 4 years ago
- DeLighT: Very Deep and Light-Weight Transformers☆469Oct 16, 2020Updated 5 years ago
- Tracking the progress in non-autoregressive generation (translation, transcription, etc.)☆302Mar 15, 2023Updated 2 years ago
- Trains Transformer model variants. Data isn't shuffled between batches.☆143Oct 5, 2022Updated 3 years ago
- Progressively Pretrained Dense Corpus Index for Open-Domain QA and Information Retrieval☆43Jun 12, 2023Updated 2 years ago
- A BART version of an open-domain QA model in a closed-book setup☆119Aug 13, 2020Updated 5 years ago
- PyTorch extensions for high performance and large scale training.☆3,400Apr 26, 2025Updated 10 months ago
- Crawling engine that crawls a set of top-level domains looking for documents in a list of languages☆11Feb 6, 2024Updated 2 years ago
- High-level API for tar-based dataset☆12Feb 3, 2024Updated 2 years ago
- ☆10Mar 29, 2021Updated 4 years ago
- PyTorch elastic training☆728Jun 15, 2022Updated 3 years ago
- LaNMT: Latent-variable Non-autoregressive Neural Machine Translation with Deterministic Inference☆79Aug 27, 2021Updated 4 years ago
- Evaluation framework for open-domain question answering.☆20May 16, 2021Updated 4 years ago