rom1504 / any2datasetLinks
Turn any collection of files into a dataset
☆45Updated 2 years ago
Alternatives and similar repositories for any2dataset
Users that are interested in any2dataset are comparing it to the libraries listed below
Sorting:
- ☆43Updated 2 years ago
- A library for squeakily cleaning and filtering language datasets.☆47Updated 2 years ago
- Load any clip model with a standardized interface☆22Updated last week
- Latent Diffusion Language Models☆69Updated last year
- [WIP] A 🔥 interface for running code in the cloud☆85Updated 2 years ago
- ☆22Updated last year
- An EXA-Scale repository of Multi-Modality AI resources from papers and models, to foundational libraries!☆40Updated last year
- Implementation of a holodeck, written in Pytorch☆18Updated last year
- One stop shop for all things carp☆59Updated 2 years ago
- Scripts to convert datasets from various sources to Hugging Face Datasets.☆57Updated 2 years ago
- **ARCHIVED** Filesystem interface to 🤗 Hub☆58Updated 2 years ago
- RWKV model implementation☆38Updated 2 years ago
- Rust bindings for CTranslate2☆14Updated 2 years ago
- ☆39Updated 2 years ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆50Updated last year
- A case study of efficient training of large language models using commodity hardware.☆68Updated 3 years ago
- ☆23Updated 8 months ago
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆66Updated 2 years ago
- Ludwig benchmark☆19Updated 3 years ago
- A sample pattern for running CI tests on Modal☆18Updated 4 months ago
- Developing tools to automatically analyze datasets☆74Updated 9 months ago
- A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆32Updated 2 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated 2 years ago
- Implementation of Metaformer, but in an autoregressive manner☆27Updated 3 years ago
- A clone of OpenAI's Tokenizer page for HuggingFace Models☆45Updated last year
- Utilities for Training Very Large Models☆58Updated 11 months ago
- Visualising Losses in Deep Neural Networks☆16Updated last year
- Smol but mighty language model☆63Updated 2 years ago
- O-GIA is an umbrella for research, infrastructure and projects ecosystem that should provide open source, reproducible datasets, models, …☆90Updated 2 years ago
- ☆19Updated 2 years ago