rom1504 / any2datasetLinks
Turn any collection of files into a dataset
☆45Updated 2 years ago
Alternatives and similar repositories for any2dataset
Users that are interested in any2dataset are comparing it to the libraries listed below
Sorting:
- ☆43Updated 2 years ago
- A library for squeakily cleaning and filtering language datasets.☆47Updated last year
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆50Updated 3 years ago
- ☆22Updated last year
- Load any clip model with a standardized interface☆21Updated last year
- Implementation of a holodeck, written in Pytorch☆18Updated last year
- Training a model similar to OpenAI DALL-E with volunteers from all over the Internet using hivemind and dalle-pytorch (NeurIPS 2021 demo)☆26Updated 2 years ago
- code for paper "Accessing higher dimensions for unsupervised word translation"☆21Updated 2 years ago
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Updated last year
- Latent Diffusion Language Models☆68Updated last year
- A synthetic story narration dataset to study small audio LMs.☆32Updated last year
- ☆23Updated 6 months ago
- One stop shop for all things carp☆59Updated 2 years ago
- A dashboard for exploring timm learning rate schedulers☆19Updated 7 months ago
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated last year
- ☆26Updated 2 years ago
- RWKV model implementation☆38Updated last year
- Automatically take good care of your preemptible TPUs☆36Updated 2 years ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 9 months ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆50Updated last year
- ☆19Updated 2 years ago
- Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)☆51Updated 3 months ago
- A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆32Updated 2 years ago
- Low-Rank Adaptation of Large Language Models clean implementation☆8Updated last year
- A sample pattern for running CI tests on Modal☆18Updated 2 months ago
- Another attempt at a long-context / efficient transformer by me☆38Updated 3 years ago
- Visualize multi-model embedding spaces. The first goal is to quickly get a lay of the land of any embedding space. Then be able to scroll…☆27Updated last year
- [WIP] A 🔥 interface for running code in the cloud☆85Updated 2 years ago
- Rust bindings for CTranslate2☆14Updated 2 years ago
- implementation of https://arxiv.org/pdf/2312.09299☆21Updated 11 months ago