Alternatives and similar repositories for webcorpus

Users that are interested in webcorpus are comparing it to the libraries listed below

• AI4Bharat / indicTrans
  indicTranslate v1 - Machine Translation for 11 Indic languages. For latest v2, check: https://github.com/AI4Bharat/IndicTrans2
  ☆130Updated last year
• project-anuvaad / anuvaad-parallel-corpus
  ☆20Updated 3 years ago
• cfiltnlp / HiNER
  This repository contains the HiNER dataset released with our paper at LREC 2022
  ☆15Updated 2 years ago
• hellohaptik / HINT3
  This repository contains datasets and code for the paper "HINT3: Raising the bar for Intent Detection in the Wild" accepted at EMNLP-2020…
  ☆33Updated 4 years ago
• masakhane-io / masakhane-ner
  ☆112Updated last year
• AI4Bharat / indic-bart
  Pre-trained, multilingual sequence-to-sequence models for Indian languages
  ☆50Updated 3 years ago
• midas-research / bhaav
  Dataset of sentences from Hindi stories tagged with different emotion tags
  ☆11Updated 5 years ago
• Open-Speech-EkStep / vakyansh-models
  Open source speech to text models for Indic Languages
  ☆308Updated 3 years ago
• masakhane-io / lafand-mt
  MAFAND-MT
  ☆59Updated last year
• infinitylogesh / mutate
  A library to synthesize text datasets using Large Language Models (LLM)
  ☆151Updated 2 years ago
• AI4Bharat / IndicBERT
  Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME
  ☆103Updated 6 months ago
• AI4Bharat / indicnlp_corpus
  Description Describes the IndicNLP corpus and associated datasets
  ☆187Updated 2 years ago
• facebookresearch / muss
  Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".
  ☆99Updated 2 years ago
• BPYap / BERT-WSD
  [EMNLP-Findings 2020] Adapting BERT for Word Sense Disambiguation with Gloss Selection Objective and Example Sentences
  ☆63Updated last year
• kaustubhdhole / natural-dont-know
  Code for the paper: Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queries
  ☆19Updated 3 years ago
• uds-lsv / afro-maft
  ☆17Updated 2 years ago
• csebuetnlp / xl-sum
  This repository contains the code, data, and models of the paper titled "XL-Sum: Large-Scale Multilingual Abstractive Summarization for 4…
  ☆275Updated last year
• Open-Speech-EkStep / vakyansh-tts
  Text to Speech for Indic languages
  ☆51Updated 3 years ago
• allenai / gooaq
  Question-answers, collected from Google
  ☆128Updated 4 years ago
• mhagiwara / xfspell
  xfspell — the Transformer Spell Checker
  ☆189Updated 5 years ago
• AI4Bharat / IndicInstruct
  Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"
  ☆61Updated 11 months ago
• castorini / afriberta
  AfriBERTa: Exploring the Viability of Pretrained Multilingual Language Models for Low-resourced Languages
  ☆77Updated 3 years ago
• microsoft / GLUECoS
  A benchmark for code-switched NLP, ACL 2020
  ☆75Updated last year
• patrickvonplaten / notebooks
  Some notebooks for NLP
  ☆207Updated last year
• hellohaptik / spello
  Fast and accurate spell correction library
  ☆81Updated 3 years ago
• Geotrend-research / smaller-transformers
  Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.
  ☆105Updated 3 years ago
• prajdabre / yanmtt
  Yet Another Neural Machine Translation Toolkit
  ☆178Updated 7 months ago
• shantipriyap / Odia-NLP-Resource-Catalog
  ☆33Updated last year
• ccasimiro88 / TranslateAlignRetrieve
  Python-based implementation of the Translate-Align-Retrieve method to automatically translate the SQuAD Dataset to Spanish.
  ☆59Updated 2 years ago
• patil-suraj / onnx_transformers
  Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.
  ☆127Updated 4 years ago