AlignInc / aligner-replication
The reproduct of the paper - Aligner: Achieving Efficient Alignment through Weak-to-Strong Correction
☆21Updated 3 months ago
Related projects: ⓘ
- Challenge LLMs to Reason About Reasoning: A Benchmark to Unveil Cognitive Depth in LLMs☆38Updated 2 months ago
- Co-LLM: Learning to Decode Collaboratively with Multiple Language Models☆89Updated 4 months ago
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)☆25Updated 6 months ago
- ☆22Updated 3 months ago
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆23Updated last year
- "Improving Mathematical Reasoning with Process Supervision" by OPENAI☆55Updated last week
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆44Updated 8 months ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆46Updated 5 months ago
- This is the official repository for Inheritune.☆89Updated 4 months ago
- The official implementation of Self-Exploring Language Models (SELM)☆55Updated 3 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆123Updated 6 months ago
- FuseAI Project☆75Updated 3 weeks ago
- A repository for research on medium sized language models.☆71Updated 3 months ago
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"☆42Updated last week
- Official repository for paper "GTA: A Benchmark for General Tool Agents"☆28Updated 2 months ago
- LMTuner: Make the LLM Better for Everyone☆33Updated 11 months ago
- Reformatted Alignment☆111Updated 4 months ago
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆87Updated 8 months ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆48Updated last week
- GoldFinch and other hybrid transformer components☆38Updated 2 months ago
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆65Updated last month
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆73Updated 2 months ago
- Data preparation code for CrystalCoder 7B LLM☆42Updated 4 months ago
- Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)☆47Updated 5 months ago
- ☆30Updated 4 months ago
- Linear Attention Sequence Parallelism (LASP)☆64Updated 3 months ago
- Plug in and play implementation of " Textbooks Are All You Need", ready for training, inference, and dataset generation☆75Updated last year
- Unofficial implementation of AlpaGasus☆83Updated 11 months ago
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆72Updated 8 months ago
- CodeUltraFeedback: aligning large language models to coding preferences☆62Updated 2 months ago