wangitu / Ada-Instruct
☆17Updated 9 months ago
Alternatives and similar repositories for Ada-Instruct:
Users that are interested in Ada-Instruct are comparing it to the libraries listed below
- Data preparation code for CrystalCoder 7B LLM☆44Updated 8 months ago
- ☆48Updated 2 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated 10 months ago
- ☆74Updated last year
- ☆31Updated 7 months ago
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- Code for NeurIPS LLM Efficiency Challenge☆54Updated 9 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆52Updated 11 months ago
- Tune MPTs☆84Updated last year
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆40Updated 10 months ago
- ☆49Updated 10 months ago
- A repository for research on medium sized language models.☆76Updated 8 months ago
- Data preparation code for Amber 7B LLM☆84Updated 8 months ago
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"☆42Updated 2 months ago
- ☆110Updated 4 months ago
- Codebase accompanying the Summary of a Haystack paper.☆74Updated 4 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- ☆52Updated 7 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆53Updated 5 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- ☆33Updated 6 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆66Updated 3 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆34Updated 9 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated 10 months ago
- ☆62Updated 6 months ago
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆76Updated last year
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated last year
- Code for KaLM-Embedding models☆68Updated 2 weeks ago
- ☆17Updated 8 months ago