Alternatives and similar repositories for seacrowd-datahub

Users that are interested in seacrowd-datahub are comparing it to the libraries listed below

• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆103Updated last year
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆148Updated 2 months ago
• google-research / metricx
  ☆106Updated 8 months ago
• IndoNLP / nusa-writes
  NusaWrites is an in-depth analysis of corpora collection strategy and a comprehensive language modeling benchmark for underrepresented an…
  ☆25Updated 10 months ago
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆97Updated 2 years ago
• faridlazuarda / cultural-llm-papers
  A curated list of research papers and resources on Cultural LLM.
  ☆46Updated 10 months ago
• shon-otmazgin / fastcoref
  ☆168Updated last year
• simran-khanuja / awesome-cultural-nlp
  Resources for cultural NLP research
  ☆101Updated 3 months ago
• amazon-science / mintaka
  Dataset from the paper "Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering" (COLING 2022)
  ☆114Updated 2 years ago
• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆112Updated 5 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆132Updated last year
• abrazinskas / sigir2022-opinion-summarization-tutorial
  This repository contains materials for the SIGIR 2022 tutorial on opinion summarization.
  ☆34Updated 3 years ago
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆70Updated last year
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆94Updated 2 years ago
• google-research / url-nlp
  ☆218Updated 3 weeks ago
• allenai / PRIMER
  The official code for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization
  ☆157Updated 2 years ago
• castorini / mr.tydi
  Mr. TyDi is a multi-lingual benchmark dataset built on TyDi, covering eleven typologically diverse languages.
  ☆78Updated 3 years ago
• apple / ml-mkqa
  We introduce MKQA, an open-domain question answering evaluation set comprising 10k question-answer pairs aligned across 26 typologically …
  ☆185Updated 3 years ago
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆73Updated last year
• esdurmus / Wikilingua
  Multilingual abstractive summarization dataset extracted from WikiHow.
  ☆94Updated 5 months ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆59Updated last year
• ymoslem / Adaptive-MT-LLM-Fine-tuning
  Fine-tuning Open-Source LLMs for Adaptive Machine Translation
  ☆85Updated last month
• aisingapore / sgnlp
  Machine learning models from Singapore's NLP research community
  ☆36Updated 2 years ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆85Updated last year
• SapienzaNLP / consec
  Text Extraction Formulation + Feedback Loop for state-of-the-art WSD (EMNLP 2021)
  ☆53Updated 3 years ago
• guyfe / Tweetsumm
  A dataset focused on summarization of dialogs, which represents the rich domain of Twitter customer care conversations
  ☆33Updated last year
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆129Updated last year
• nlpsoc / Style-Embeddings
  ☆37Updated 10 months ago
• BatsResearch / crosslingual-test-time-scaling
  Crosslingual Reasoning through Test-Time Scaling
  ☆19Updated 3 months ago
• ThomasScialom / QuestEval
  ☆100Updated last year