nlp-uoregon / Okapi
Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
☆92Updated last year
Alternatives and similar repositories for Okapi:
Users that are interested in Okapi are comparing it to the libraries listed below
- Multilingual Large Language Models Evaluation Benchmark☆117Updated 6 months ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆99Updated 10 months ago
- A Multilingual Replicable Instruction-Following Model☆94Updated last year
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆125Updated 11 months ago
- Code for Zero-Shot Tokenizer Transfer☆120Updated last month
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆70Updated 11 months ago
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆67Updated 11 months ago
- ☆96Updated 2 years ago
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆89Updated last year
- [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision☆84Updated 3 months ago
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆55Updated 6 months ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆206Updated 3 months ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆162Updated last year
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆83Updated 6 months ago
- Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation☆33Updated 11 months ago
- ☆73Updated last year
- A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.☆71Updated 6 months ago
- ☆139Updated 10 months ago
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆175Updated last month
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning☆29Updated 2 years ago
- Code and data for the paper "Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?"☆25Updated 2 months ago
- Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆116Updated 2 months ago
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆56Updated 8 months ago
- Machine Reading Comprehension special for the Vietnamese language☆40Updated 2 years ago
- German Alpaca Dataset (Cleaned + Translated)☆24Updated last year
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆98Updated 2 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆67Updated 4 months ago
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆179Updated 2 years ago
- ☆117Updated 4 months ago