rom1504 / any2datasetLinks
Turn any collection of files into a dataset
☆45Updated 2 years ago
Alternatives and similar repositories for any2dataset
Users that are interested in any2dataset are comparing it to the libraries listed below
Sorting:
- ☆44Updated 2 years ago
- A library for squeakily cleaning and filtering language datasets.☆48Updated 2 years ago
- [WIP] A 🔥 interface for running code in the cloud☆85Updated 2 years ago
- Latent Diffusion Language Models☆69Updated 2 years ago
- Load any clip model with a standardized interface☆21Updated last month
- One stop shop for all things carp☆59Updated 3 years ago
- A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆31Updated 2 years ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆50Updated 3 years ago
- **ARCHIVED** Filesystem interface to 🤗 Hub☆58Updated 2 years ago
- ML/DL Math and Method notes☆64Updated last year
- ☆22Updated 2 years ago
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆115Updated 2 years ago
- Developing tools to automatically analyze datasets☆75Updated last year
- O-GIA is an umbrella for research, infrastructure and projects ecosystem that should provide open source, reproducible datasets, models, …☆89Updated 2 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆35Updated 2 years ago
- 🚀🤗 A collection of templates for Hugging Face Spaces☆35Updated 2 years ago
- My explorations into editing the knowledge and memories of an attention network☆34Updated 2 years ago
- ☆23Updated 11 months ago
- Scripts to convert datasets from various sources to Hugging Face Datasets.☆57Updated 3 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆62Updated 2 years ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆51Updated last year
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆67Updated 2 years ago
- Python Research Framework☆106Updated 3 years ago
- Thispersondoesnotexist went down, so this time, while building it back up, I am going to open source all of it.☆90Updated 2 years ago
- A case study of efficient training of large language models using commodity hardware.☆68Updated 3 years ago
- ☆44Updated last year
- Ludwig benchmark☆19Updated 3 years ago
- Utilities for Training Very Large Models☆58Updated last year
- Efficiently read embedding in streaming from any filesystem☆102Updated 3 months ago
- A dashboard for exploring timm learning rate schedulers☆19Updated 11 months ago