CarperAI / cheese
Used for adaptive human in the loop evaluation of language and embedding models.
☆300Updated last year
Related projects: ⓘ
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆190Updated 3 months ago
- Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)☆456Updated last year
- DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.☆163Updated 4 months ago
- ☆158Updated last year
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆115Updated last year
- Ask Me Anything language model prompting☆536Updated last year
- Experiments with generating opensource language model assistants☆97Updated last year
- Multipack distributed sampler for fast padding-free training of LLMs☆170Updated last month
- TART: A plug-and-play Transformer module for task-agnostic reasoning☆188Updated last year
- Scaling Data-Constrained Language Models☆310Updated this week
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆204Updated 8 months ago
- ☆127Updated 2 years ago
- Prompt programming with FMs.☆437Updated last month
- Pipeline for pulling and processing online language model pretraining data from the web☆172Updated last year
- ☆174Updated last year
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆143Updated 2 months ago
- A crude RLHF layer on top of nanoGPT with Gumbel-Softmax trick☆283Updated 9 months ago
- ☆91Updated 5 months ago
- OpenAlpaca: A Fully Open-Source Instruction-Following Model Based On OpenLLaMA☆301Updated last year
- The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…☆122Updated last year
- Code and data for "Measuring and Narrowing the Compositionality Gap in Language Models"☆293Updated 8 months ago
- A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs☆112Updated last year
- Implementation of Reinforcement Learning from Human Feedback (RLHF)☆168Updated last year
- ☆217Updated last year
- ☆229Updated 2 months ago
- Code repository for the c-BTM paper☆105Updated 11 months ago
- Erasing concepts from neural representations with provable guarantees☆202Updated 3 months ago
- A dataset featuring diverse dialogues between two ChatGPT (gpt-3.5-turbo) instances with system messages written by GPT-4. Covering vario…☆165Updated last year
- Simple Annotated implementation of GPT-NeoX in PyTorch☆110Updated 2 years ago
- Code accompanying the paper Pretraining Language Models with Human Preferences☆173Updated 7 months ago