Efficient, check-pointed data loading for deep learning with massive data sets.
☆212Jun 12, 2023Updated 2 years ago
Alternatives and similar repositories for infinibatch
Users that are interested in infinibatch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- int8_t and int16_t matrix multiply based on https://arxiv.org/abs/1705.01991☆73Dec 30, 2023Updated 2 years ago
- ☆107Apr 15, 2021Updated 4 years ago
- The implementation of the paper "Harvesting and Refining Question-Answer Pairs for Unsupervised QA"☆33Nov 25, 2020Updated 5 years ago
- A library for data streaming and augmentation☆21May 5, 2025Updated 10 months ago
- Prefetch elements from a Python generator in the background, from a separate process☆34Mar 25, 2021Updated 4 years ago
- Configure Python functions explicitly and safely☆129Nov 18, 2024Updated last year
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,124Apr 20, 2022Updated 3 years ago
- An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…☆433Aug 17, 2022Updated 3 years ago
- Code for EMNLP2021 paper "Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training"☆20Nov 12, 2021Updated 4 years ago
- This is a C++ implementation of cocoapi bbox evaluation code.☆11Dec 9, 2021Updated 4 years ago
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆24Jun 6, 2024Updated last year
- Based on https://github.com/fatchord/WaveRNN☆24May 3, 2020Updated 5 years ago
- Fast Block Sparse Matrices for Pytorch☆549Jan 21, 2021Updated 5 years ago
- Language model powered proof reader for correcting contextual errors in natural language.☆24Jul 6, 2023Updated 2 years ago
- High-level API for tar-based dataset☆12Feb 3, 2024Updated 2 years ago
- PyTorch implementation for PaLM: A Hybrid Parser and Language Model.☆10Jan 7, 2020Updated 6 years ago
- Source code for: On the Effect of Low-Frequency Terms on Neural-IR Models, SIGIR'19☆48Apr 30, 2019Updated 6 years ago
- Here we will test various linear attention designs.☆62Apr 25, 2024Updated last year
- High performance model preprocessing library on PyTorch☆648Mar 29, 2024Updated last year
- Efficient Low-Memory Aligner☆146Jan 15, 2025Updated last year
- Parallelized automatic corpus collection for ASR. Forked from https://github.com/EgorLakomkin/KTSpeechCrawler☆23Mar 21, 2021Updated 5 years ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆22Jan 25, 2023Updated 3 years ago
- Code to support the paper "Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets"☆65Aug 31, 2021Updated 4 years ago
- Materials of public talks given By SJTU X-LANCE members☆14Dec 3, 2022Updated 3 years ago
- ☆11Oct 11, 2023Updated 2 years ago
- Pytorch library for fast transformer implementations☆1,763Mar 23, 2023Updated 3 years ago
- PyTorch extensions for high performance and large scale training.☆3,404Apr 26, 2025Updated 10 months ago
- PyProf2: PyTorch Profiling tool☆82Jun 25, 2020Updated 5 years ago
- Progressively Pretrained Dense Corpus Index for Open-Domain QA and Information Retrieval☆43Jun 12, 2023Updated 2 years ago
- DeLighT: Very Deep and Light-Weight Transformers☆469Oct 16, 2020Updated 5 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 2 years ago
- ☆13Aug 20, 2021Updated 4 years ago
- Non Metric Space ( Approximate ) Library in R☆12Feb 2, 2023Updated 3 years ago
- Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.☆135Dec 10, 2023Updated 2 years ago
- A BART version of an open-domain QA model in a closed-book setup☆119Aug 13, 2020Updated 5 years ago
- Colab notebooks for d2l-book☆11Dec 5, 2019Updated 6 years ago
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,251Updated this week
- ☆22Dec 15, 2023Updated 2 years ago
- Tracking the progress in non-autoregressive generation (translation, transcription, etc.)☆302Mar 15, 2023Updated 3 years ago