Alternatives and similar repositories for seacrowd-datahub

Users that are interested in seacrowd-datahub are comparing it to the libraries listed below

• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆107Updated last year
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆186Updated 2 months ago
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆96Updated 2 years ago
• faridlazuarda / cultural-llm-papers
  A curated list of research papers and resources on Cultural LLM.
  ☆53Updated last year
• google-research / metricx
  ☆127Updated last week
• shon-otmazgin / fastcoref
  ☆182Updated last year
• simran-khanuja / awesome-cultural-nlp
  Resources for cultural NLP research
  ☆113Updated 4 months ago
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆72Updated last year
• IndoNLP / nusa-writes
  NusaWrites is an in-depth analysis of corpora collection strategy and a comprehensive language modeling benchmark for underrepresented an…
  ☆27Updated last year
• amazon-science / mintaka
  Dataset from the paper "Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering" (COLING 2022)
  ☆118Updated 3 years ago
• cardiffnlp / timelms
  TimeLMs: Diachronic Language Models from Twitter
  ☆112Updated last year
• nlpsoc / Style-Embeddings
  ☆41Updated last year
• google-research / url-nlp
  ☆256Updated 5 months ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆95Updated 2 years ago
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆133Updated last year
• aisingapore / sealion
  South-East Asia Large Language Models
  ☆383Updated this week
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆204Updated last week
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆136Updated last year
• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆125Updated 3 months ago
• vivek3141 / ghostbuster
  Ghostbuster: Detecting Text Ghostwritten by Large Language Models (NAACL 2024)
  ☆176Updated last year
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆74Updated last year
• qcri / LLMeBench
  Benchmarking Large Language Models
  ☆105Updated 7 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆142Updated last year
• s-nlp / detox
  Models for automatically transforming toxic text to neutral
  ☆35Updated 2 years ago
• facebookresearch / belebele
  Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.
  ☆340Updated last year
• viswavi / few-shot-clustering
  ☆80Updated last year
• csebuetnlp / xl-sum
  This repository contains the code, data, and models of the paper titled "XL-Sum: Large-Scale Multilingual Abstractive Summarization for 4…
  ☆277Updated last year
• google-research-datasets / seegull
  SeeGULL is a broad-coverage stereotype dataset in English containing stereotypes about identity groups spanning 178 countries across 8 di…
  ☆38Updated 2 years ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆64Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆226Updated last year