Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.
☆137Dec 10, 2023Updated 2 years ago
Alternatives and similar repositories for tarp
Users that are interested in tarp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Utilities for sequential processing of tar files.☆25Feb 16, 2022Updated 4 years ago
- A small demonstration of using WebDataset with ImageNet and PyTorch Lightning☆76Dec 19, 2023Updated 2 years ago
- Describe the format of image/text datasets☆12Apr 26, 2022Updated 4 years ago
- Efficiently read embedding in streaming from any filesystem☆106Aug 9, 2025Updated last year
- ☆25Apr 13, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A high performance I/O library for deep learning in Julia, based on the PyTorch WebDataset library☆16Dec 18, 2025Updated 11 months ago
- Examples for the WebDataset PyTorch Dataset Library☆52Jun 15, 2021Updated 5 years ago
- ☆106Apr 15, 2021Updated 5 years ago
- Blazing fast data loading with HuggingFace Dataset and Ray Data☆15Jan 12, 2024Updated 2 years ago
- AIStore: scalable storage for AI applications☆1,969Updated this week
- Implementations of GANs in Tensorflow 2.x☆16Feb 12, 2022Updated 4 years ago
- ☆15Sep 24, 2022Updated 4 years ago
- Efficient, check-pointed data loading for deep learning with massive data sets.☆212Jun 12, 2023Updated 3 years ago
- DALLE-tools provided useful dataset utilities to improve you workflow with WebDatasets.☆14Mar 9, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- An unopinionated replacement for PyTorch's Dataset and ImageFolder, that handles Tar archives☆78Aug 10, 2022Updated 4 years ago
- I have created a dataset of Image-Text-Pairs by using the cosine similarity of the CLIP embeddings of the image & it's caption derrived f…☆18Apr 22, 2021Updated 5 years ago
- Source code for EMNLP2022 long paper: Parameter-Efficient Tuning Makes a Good Classification Head☆15Nov 7, 2022Updated 4 years ago
- Using YouTube to prepare a speech recognition dataset for any language☆10Mar 30, 2021Updated 5 years ago
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆82Jan 7, 2026Updated 10 months ago
- Fast Block Sparse Matrices for Pytorch☆551Jan 21, 2021Updated 5 years ago
- This is a offical PyTorch/GPU implementation of SupMAE.☆80Aug 30, 2022Updated 4 years ago
- Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.☆4,462Oct 19, 2025Updated last year
- A criticism of a recent paper on buggy image downsampling methods in popular image processing and deep learning libraries.☆72Jul 6, 2022Updated 4 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆25Oct 9, 2022Updated 4 years ago
- Test pytorch code with minimal computational overhead☆26Jun 8, 2023Updated 3 years ago
- Node.js/Bun NAPI bindings for faiss☆11Jul 29, 2025Updated last year
- CLOOB training (JAX) and inference (JAX and PyTorch)☆76May 16, 2022Updated 4 years ago
- Out-of-distribution generalization benchmarks for image recognition models☆13Apr 5, 2020Updated 6 years ago
- FFCV: Fast Forward Computer Vision (and other ML workloads!)☆2,995Jun 16, 2024Updated 2 years ago
- Sagemaker Studio Docker UI Extension☆12Apr 17, 2024Updated 2 years ago
- Code release for SLIP Self-supervision meets Language-Image Pre-training☆790Feb 9, 2023Updated 3 years ago
- Mistral-7B finetuned for function calling☆17Jan 28, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A project to improve out-of-distribution detection (open set recognition) and uncertainty estimation by changing a few lines of code in y…☆44Sep 22, 2022Updated 4 years ago
- ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning. In ICCV, 2021.☆65Nov 18, 2021Updated 5 years ago
- Make TFRecord Usable Again☆89Jun 3, 2023Updated 3 years ago
- T5 model optimized with FlexAttention☆14Sep 30, 2024Updated 2 years ago
- Implementation of NWT, audio-to-video generation, in Pytorch☆92Mar 17, 2022Updated 4 years ago
- ☆14Dec 13, 2024Updated last year
- Generic image compressor for machine learning. Pytorch code for our paper "Lossy compression for lossless prediction".☆122Aug 19, 2022Updated 4 years ago
Are these results useful?