Alternatives and similar repositories for seacrowd-datahub

Users that are interested in seacrowd-datahub are comparing it to the libraries listed below

• IndoNLP / nusa-writes
  NusaWrites is an in-depth analysis of corpora collection strategy and a comprehensive language modeling benchmark for underrepresented an…
  ☆25Updated 9 months ago
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆97Updated last year
• BatsResearch / LexC-Gen
  Generate synthetic labeled data for extremely low-resource languages using bilingual lexicons.
  ☆16Updated 9 months ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆103Updated last year
• faridlazuarda / cultural-llm-papers
  A curated list of research papers and resources on Cultural LLM.
  ☆45Updated 9 months ago
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆70Updated last year
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆94Updated 2 years ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆131Updated last year
• google-research / metricx
  ☆102Updated 7 months ago
• google-research / url-nlp
  ☆215Updated 2 weeks ago
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆127Updated 10 months ago
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆144Updated last month
• cardiffnlp / timelms
  TimeLMs: Diachronic Language Models from Twitter
  ☆108Updated last year
• facebookresearch / belebele
  Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.
  ☆332Updated 6 months ago
• MicrosoftTranslator / GEMBA
  GEMBA — GPT Estimation Metric Based Assessment
  ☆119Updated 11 months ago
• abrazinskas / sigir2022-opinion-summarization-tutorial
  This repository contains materials for the SIGIR 2022 tutorial on opinion summarization.
  ☆34Updated 2 years ago
• dadelani / sib-200
  SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects
  ☆21Updated 5 months ago
• BatsResearch / crosslingual-test-time-scaling
  Crosslingual Reasoning through Test-Time Scaling
  ☆18Updated 2 months ago
• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆110Updated 4 months ago
• csebuetnlp / xl-sum
  This repository contains the code, data, and models of the paper titled "XL-Sum: Large-Scale Multilingual Abstractive Summarization for 4…
  ☆271Updated last year
• julian-risch / toxic-comment-collection
  Code for our WOAH@ACL 2021 Paper on Data Integration for Toxic Comment Classification: Making More Than 40 Datasets Easily Accessible in …
  ☆29Updated 3 years ago
• huggingface / that_is_good_data
  ☆66Updated last year
• shon-otmazgin / fastcoref
  ☆165Updated last year
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆106Updated 8 months ago
• allenai / PRIMER
  The official code for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization
  ☆156Updated 2 years ago
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆73Updated last year
• kasnerz / tabgenie
  A multi-purpose toolkit for table-to-text generation: web interface, Python bindings, CLI commands.
  ☆55Updated last year
• ThomasScialom / QuestEval
  ☆98Updated last year
• HySonLab / ViDeBERTa
  ViDeBERTa: A powerful pre-trained language model for Vietnamese, EACL 2023
  ☆56Updated last year
• google-research / xtreme-up
  ☆51Updated 2 years ago