ltgoslo / bert-in-context
Official implementation of "BERTs are Generative In-Context Learners"
☆26Updated last month
Alternatives and similar repositories for bert-in-context:
Users that are interested in bert-in-context are comparing it to the libraries listed below
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 7 months ago
- Exploration of automated dataset selection approaches at large scales.☆37Updated last month
- ☆67Updated 8 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆71Updated 5 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆47Updated last year
- ☆31Updated 3 months ago
- ☆26Updated 8 months ago
- Aioli: A unified optimization framework for language model data mixing☆23Updated 2 months ago
- ☆45Updated last month
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆25Updated 5 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆42Updated last year
- One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation☆39Updated 6 months ago
- A repository for research on medium sized language models.☆76Updated 10 months ago
- [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers☆63Updated 2 months ago
- ☆44Updated 3 weeks ago
- ☆79Updated last year
- ☆41Updated last week
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆73Updated 4 months ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆29Updated 3 weeks ago
- PyTorch library for Active Fine-Tuning☆63Updated last month
- ☆17Updated 6 months ago
- Codebase for Instruction Following without Instruction Tuning☆34Updated 6 months ago
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆68Updated 9 months ago
- The repository contains code for Adaptive Data Optimization☆20Updated 4 months ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆52Updated last year
- ☆48Updated 5 months ago
- PyTorch implementation for MRL☆18Updated last year
- ☆77Updated 7 months ago
- ☆26Updated 9 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆72Updated 7 months ago