LAION-AI / Open-GIA
O-GIA is an umbrella for research, infrastructure and projects ecosystem that should provide open source, reproducible datasets, models, applications & safety tools for Open Generalist Interactive Agents (O-GIA). O-GIA systems will act in collaboration with human or autonomously, supporting various kind of validated decision making and assistanc…
☆91Updated last year
Related projects: ⓘ
- Aim for the moon. If you miss, you may hit a star.☆157Updated last year
- ☆64Updated 11 months ago
- [WIP] A 🔥 interface for running code in the cloud☆86Updated last year
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts☆101Updated last year
- Tools for content datamining and NLP at scale☆41Updated 3 months ago
- Anh - LAION's multilingual assistant datasets and models☆27Updated last year
- **ARCHIVED** Filesystem interface to 🤗 Hub☆56Updated last year
- Simple large-scale training of stable diffusion with multi-node support.☆122Updated last year
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆115Updated last year
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated 11 months ago
- Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch☆222Updated 2 weeks ago
- ☆98Updated 7 months ago
- RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.☆65Updated 2 years ago
- Implementation of the deepmind Flamingo vision-language model, based on Hugging Face language models and ready for training☆163Updated last year
- Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT☆202Updated last month
- Easily compute clip embeddings from video frames☆133Updated 10 months ago
- Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…☆183Updated 3 weeks ago
- Un-*** 50 billions multimodality dataset☆24Updated 2 years ago
- Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI☆58Updated last year
- The Next Generation Multi-Modality Superintelligence☆69Updated 2 weeks ago
- ☆91Updated this week
- An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"☆52Updated last year
- Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto☆53Updated 4 months ago
- M4 experiment logbook☆56Updated last year
- This project aims to make RWKV Accessible to everyone using a Hugging Face like interface, while keeping it close to the R and D RWKV bra…☆63Updated last year
- Experiments with generating opensource language model assistants☆97Updated last year
- ☆72Updated last year
- Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA☆99Updated last month
- The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…☆122Updated last year
- ☆36Updated last year