learning-at-home / dalle-hivemind
Training a model similar to OpenAI DALL-E with volunteers from all over the Internet using hivemind and dalle-pytorch (NeurIPS 2021 demo)
☆27Updated last year
Related projects: ⓘ
- A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆31Updated last year
- Latent Diffusion Language Models☆66Updated last year
- Hidden Engrams: Long Term Memory for Transformer Model Inference☆34Updated 3 years ago
- Collaborative inference of latent diffusion via hivemind☆13Updated last year
- ☆21Updated 3 years ago
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆29Updated last year
- CLOOB training (JAX) and inference (JAX and PyTorch)☆70Updated 2 years ago
- ESGD-M is a stochastic non-convex second order optimizer, suitable for training deep learning models, for PyTorch.☆56Updated 2 years ago
- ☆64Updated 2 years ago
- Another attempt at a long-context / efficient transformer by me☆37Updated 2 years ago
- A GPT, made only of MLPs, in Jax☆55Updated 3 years ago
- ☆14Updated this week
- ☆30Updated 2 years ago
- A library for squeakily cleaning and filtering language datasets.☆45Updated last year
- Unified API to facilitate usage of pre-trained "perceptor" models, a la CLIP☆39Updated last year
- Train vision models using JAX and 🤗 transformers☆91Updated last week
- Dataset of Canada goose images with annotations of bounding boxes with object classes, suitable for testing object detection algorithms.☆37Updated 6 years ago
- PyTorch interface for TrueGrad Optimizers☆39Updated last year
- ☆22Updated 2 years ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆47Updated 2 years ago
- One stop shop for all things carp☆58Updated 2 years ago
- Script and models for clustering LAION-400m CLIP embeddings.☆25Updated 2 years ago
- ☆85Updated this week
- The original weights of some Caffe models, ported to PyTorch.☆11Updated 2 years ago
- Simple python template☆40Updated 4 months ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆46Updated 8 months ago
- "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implemen…☆53Updated 3 years ago
- Training simple models to predict CLIP image embeddings from text embeddings, and vice versa.☆59Updated 2 years ago
- Finetune the 1.4B latent diffusion text2img-large checkpoint from CompVis using deepspeed. (work-in-progress)☆36Updated 2 years ago
- Refactoring dalle-pytorch and taming-transformers for TPU VM☆60Updated 3 years ago