LLM360 / amber-data-prep
Data preparation code for Amber 7B LLM
☆85Updated 9 months ago
Alternatives and similar repositories for amber-data-prep:
Users that are interested in amber-data-prep are comparing it to the libraries listed below
- Data preparation code for CrystalCoder 7B LLM☆44Updated 9 months ago
- Pre-training code for Amber 7B LLM☆164Updated 9 months ago
- Pre-training code for CrystalCoder 7B LLM☆55Updated 9 months ago
- Open Implementations of LLM Analyses☆101Updated 4 months ago
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆75Updated last year
- Code repository for the c-BTM paper☆105Updated last year
- ☆74Updated last year
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆35Updated 10 months ago
- Evaluating LLMs with CommonGen-Lite☆89Updated 11 months ago
- ☆48Updated 3 months ago
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆204Updated 9 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- ☆47Updated 6 months ago
- Experiments on speculative sampling with Llama models☆125Updated last year
- Small and Efficient Mathematical Reasoning LLMs☆71Updated last year
- FuseAI Project☆83Updated last month
- This is the official repository for Inheritune.☆109Updated 3 weeks ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆73Updated 4 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆253Updated 7 months ago
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).☆204Updated last week
- QuIP quantization☆51Updated 11 months ago
- Multipack distributed sampler for fast padding-free training of LLMs☆184Updated 6 months ago
- A pipeline for LLM knowledge distillation☆94Updated last month
- ☆113Updated 5 months ago
- My fork os allen AI's OLMo for educational purposes.☆30Updated 2 months ago
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆95Updated last year
- Just a bunch of benchmark logs for different LLMs☆119Updated 7 months ago
- Codebase accompanying the Summary of a Haystack paper.☆75Updated 5 months ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆115Updated last year
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆150Updated last year