EleutherAI / pythia
The hub for EleutherAI's work on interpretability and learning dynamics
☆2,410Updated this week
Alternatives and similar repositories for pythia:
Users that are interested in pythia are comparing it to the libraries listed below
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆2,460Updated 7 months ago
- The RedPajama-Data repository contains code for preparing large datasets for training large language models.☆4,674Updated 3 months ago
- A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆4,596Updated last year
- Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"☆1,701Updated last year
- YaRN: Efficient Context Window Extension of Large Language Models☆1,446Updated 10 months ago
- A modular RL library to fine-tune language models to human preferences☆2,286Updated last year
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆5,831Updated last year
- Aligning pretrained language models with instruction data generated by themselves.☆4,307Updated last year
- Alpaca dataset from Stanford, cleaned and curated☆1,540Updated last year
- Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09…☆2,099Updated this week
- ☆1,506Updated this week
- 4 bits quantization of LLaMA using GPTQ☆3,045Updated 8 months ago
- An open-source framework for training large multimodal models.☆3,841Updated 6 months ago
- ☆2,765Updated last week
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,039Updated 6 months ago
- General technology for enabling AI capabilities w/ LLMs and MLLMs☆3,885Updated 2 months ago
- Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI☆2,010Updated 7 months ago
- [NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333☆1,093Updated last year
- A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)☆1,114Updated last year
- Toolkit for creating, sharing and using natural language prompts.☆2,792Updated last year
- Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".☆2,058Updated 11 months ago
- Cramming the training of a (BERT-type) language model into limited compute.☆1,322Updated 9 months ago
- Accessible large language models via k-bit quantization for PyTorch.☆6,793Updated this week
- Instruction Tuning with GPT-4☆4,279Updated last year
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆1,681Updated 2 months ago
- Benchmarking large language models' complex reasoning ability with chain-of-thought prompting☆2,687Updated 7 months ago
- Fast & Simple repository for pre-training and fine-tuning T5-style models☆999Updated 6 months ago
- A framework for few-shot evaluation of language models.☆8,213Updated this week
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆920Updated 4 months ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆1,373Updated 11 months ago