Dahoas / gpt-neox-finetuningLinks
☆15Updated 3 years ago
Alternatives and similar repositories for gpt-neox-finetuning
Users that are interested in gpt-neox-finetuning are comparing it to the libraries listed below
Sorting:
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆187Updated 3 months ago
- Tools for managing datasets for governance and training.☆85Updated 2 weeks ago
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆67Updated 2 years ago
- ☆169Updated 7 months ago
- Tool to apply Legal Matter Specification Standard (LMSS) to documents☆12Updated last year
- [WIP] A 🔥 interface for running code in the cloud☆85Updated 2 years ago
- Efficient few-shot learning with cross-encoders.☆59Updated last year
- 📚 Datasets and models for instruction-tuning☆239Updated 2 years ago
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆169Updated last year
- Experiments with generating opensource language model assistants☆97Updated 2 years ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆66Updated last year
- Completion After Prompt Probability. Make your LLM make a choice☆80Updated 11 months ago
- Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.☆48Updated 3 years ago
- A TextTiling-based algorithm for text segmentation (aka topic segmentation) that uses neural sentence encoders, as well as extractive sum…☆49Updated 2 years ago
- A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs☆115Updated 2 years ago
- Using short models to classify long texts☆21Updated 2 years ago
- Reverse Instructions to generate instruction tuning data with corpus examples☆214Updated last year
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆115Updated 2 years ago
- A library for squeakily cleaning and filtering language datasets.☆46Updated 2 years ago
- Fine-tuning 6-Billion GPT-J (& other models) with LoRA and 8-bit compression☆68Updated 3 years ago
- Pipeline for pulling and processing online language model pretraining data from the web☆177Updated 2 years ago
- ☆17Updated last year
- ☆57Updated last year
- Developing tools to automatically analyze datasets☆75Updated 11 months ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆95Updated 2 years ago
- Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.☆335Updated 9 months ago
- A demonstration of a multilingual semantic search engine you can be quickly built using Cohere's platform.☆63Updated 2 years ago
- A dataset featuring diverse dialogues between two ChatGPT (gpt-3.5-turbo) instances with system messages written by GPT-4. Covering vario…☆164Updated 2 years ago
- [EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.☆109Updated last year
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆162Updated 4 months ago