leloykun / mmsg
Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.
☆27Updated 6 months ago
Alternatives and similar repositories for mmsg:
Users that are interested in mmsg are comparing it to the libraries listed below
- Training hybrid models for dummies.☆21Updated 3 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated last month
- ☆33Updated 10 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Latent Large Language Models☆18Updated 8 months ago
- ☆25Updated last year
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 7 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆27Updated 7 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated last week
- A new way to generate large quantities of high quality synthetic data (on par with GPT-4), with better controllability, at a fraction of …☆22Updated 7 months ago
- Code, results and other artifacts from the paper introducing the WildChat-50m dataset and the Re-Wild model family.☆29Updated last month
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- ☆33Updated 8 months ago
- A list of language models with permissive licenses such as MIT or Apache 2.0☆24Updated 2 months ago
- ☆35Updated last year
- QLoRA with Enhanced Multi GPU Support☆37Updated last year
- A dashboard for exploring timm learning rate schedulers☆19Updated 5 months ago
- Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…☆23Updated 3 months ago
- ☆22Updated last year
- Entailment self-training☆25Updated last year
- ☆43Updated 3 months ago
- ☆21Updated 6 months ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 11 months ago
- ☆18Updated 7 months ago
- GoldFinch and other hybrid transformer components☆45Updated 9 months ago
- https://hf.co/hexgrad/Kokoro-82M☆14Updated 2 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- Aioli: A unified optimization framework for language model data mixing☆25Updated 3 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆57Updated 8 months ago