wangitu / Ada-Instruct
☆17Updated 7 months ago
Related projects ⓘ
Alternatives and complementary repositories for Ada-Instruct
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- ☆62Updated last month
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- ☆26Updated 4 months ago
- Data preparation code for CrystalCoder 7B LLM☆42Updated 6 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆46Updated 2 months ago
- ☆44Updated 2 months ago
- Code for NeurIPS LLM Efficiency Challenge☆53Updated 7 months ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆51Updated this week
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"☆42Updated this week
- This is the official repository for Inheritune.☆105Updated last month
- ☆38Updated this week
- Anh - LAION's multilingual assistant datasets and models☆27Updated last year
- ☆49Updated 7 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 8 months ago
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated last year
- Multi-Domain Expert Learning☆67Updated 9 months ago
- Evaluating LLMs with Dynamic Data☆68Updated this week
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆38Updated 9 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆44Updated 9 months ago
- Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding☆37Updated 3 weeks ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆77Updated 7 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆22Updated 7 months ago
- A repository for research on medium sized language models.☆74Updated 5 months ago
- Code repository for the c-BTM paper☆105Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated 10 months ago
- ☆37Updated last year
- Collection of autoregressive model implementation☆66Updated this week
- ☆92Updated last month