penfever / wildchat-50mLinks
Code, results and other artifacts from the paper introducing the WildChat-50m dataset and the Re-Wild model family.
☆34Updated 10 months ago
Alternatives and similar repositories for wildchat-50m
Users that are interested in wildchat-50m are comparing it to the libraries listed below
Sorting:
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆61Updated last year
- ☆56Updated last year
- Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya☆125Updated 6 months ago
- Resa: Transparent Reasoning Models via SAEs☆47Updated 4 months ago
- ☆93Updated last month
- ☆41Updated last year
- ☆91Updated last year
- A repository for research on medium sized language models.☆77Updated last year
- Aioli: A unified optimization framework for language model data mixing☆32Updated last year
- ☆67Updated 10 months ago
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated last year
- MEXMA: Token-level objectives improve sentence representations☆42Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Updated last year
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆94Updated last year
- An automated data pipeline scaling RL to pretraining levels☆72Updated 4 months ago
- Lottery Ticket Adaptation☆40Updated last year
- Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.☆29Updated last year
- ☆26Updated last year
- The official implementation of Self-Exploring Language Models (SELM)☆63Updated last year
- [TMLR 2026] When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models☆122Updated last year
- Code for ExploreTom☆90Updated 7 months ago
- Fork of Flame repo for training of some new stuff in development☆19Updated last month
- [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers☆75Updated 7 months ago
- An unofficial pytorch implementation of 'Efficient Infinite Context Transformers with Infini-attention'☆54Updated last year
- ☆14Updated 7 months ago
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆102Updated last year
- Co-LLM: Learning to Decode Collaboratively with Multiple Language Models☆126Updated last year
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆35Updated 11 months ago
- Unofficial Implementation of Evolutionary Model Merging☆41Updated last year
- ☆57Updated last month