Alternatives and similar repositories for webcorpus

Users that are interested in webcorpus are comparing it to the libraries listed below

• AI4Bharat / indicTrans
  indicTranslate v1 - Machine Translation for 11 Indic languages. For latest v2, check: https://github.com/AI4Bharat/IndicTrans2
  ☆127Updated last year
• project-anuvaad / anuvaad-parallel-corpus
  ☆18Updated 3 years ago
• cfiltnlp / HiNER
  This repository contains the HiNER dataset released with our paper at LREC 2022
  ☆15Updated 2 years ago
• AI4Bharat / IndicBERT
  Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME
  ☆99Updated 3 months ago
• hellohaptik / HINT3
  This repository contains datasets and code for the paper "HINT3: Raising the bar for Intent Detection in the Wild" accepted at EMNLP-2020…
  ☆33Updated 4 years ago
• Open-Speech-EkStep / vakyansh-models
  Open source speech to text models for Indic Languages
  ☆306Updated 2 years ago
• AI4Bharat / indicnlp_corpus
  Description Describes the IndicNLP corpus and associated datasets
  ☆173Updated 2 years ago
• uds-lsv / afro-maft
  ☆17Updated 2 years ago
• hellohaptik / spello
  Fast and accurate spell correction library
  ☆81Updated 3 years ago
• patrickvonplaten / notebooks
  Some notebooks for NLP
  ☆205Updated last year
• AI4Bharat / IndicNLP-Transliteration
  Codebase for Indic-Transliteration using Seq2Seq RNN. For latest repo with Transformer-based models, check: https://github.com/AI4Bharat/…
  ☆60Updated 4 years ago
• masakhane-io / lafand-mt
  MAFAND-MT
  ☆57Updated last year
• praatibhsurana / Hinglish_Hindi_WSD
  A pipeline for transliteration, spell correction, POS tagging and word sense disambiguation of Hinglish code mixed data to Hindi Devanaga…
  ☆36Updated last year
• TrigonaMinima / HinglishNLP
  ☆48Updated 5 years ago
• shantipriyap / Odia-NLP-Resource-Catalog
  ☆32Updated last year
• AI4Bharat / IndicInstruct
  Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"
  ☆59Updated 8 months ago
• google-research-datasets / dakshina
  The Dakshina dataset is a collection of text in both Latin and native scripts for 12 South Asian languages. For each language, the datase…
  ☆195Updated 5 years ago
• AI4Bharat / IndicLLMSuite
  A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages
  ☆107Updated 9 months ago
• midas-research / bhaav
  Dataset of sentences from Hindi stories tagged with different emotion tags
  ☆11Updated 5 years ago
• Open-Speech-EkStep / vakyansh-tts
  Text to Speech for Indic languages
  ☆51Updated 3 years ago
• google-research-datasets / Hinglish-TOP-Dataset
  Consists of the largest (10K) human annotated code-switched semantic parsing dataset & 170K generated utterance using the CST5 augmentati…
  ☆39Updated 2 years ago
• AI4Bharat / IndicWav2Vec
  Pretraining, fine-tuning and evaluation scripts for Indic-Wav2Vec2
  ☆86Updated last year
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆84Updated last year
• Andrews2017 / africanlp-public-datasets
  A repository for publicly/freely available Natural Language Processing (NLP) datasets for African languages.
  ☆106Updated last year
• masakhane-io / masakhane-ner
  ☆109Updated last year
• PolyAI-LDN / task-specific-datasets
  A collection of task-specific NLU datasets
  ☆149Updated 3 years ago
• prajdabre / yanmtt
  Yet Another Neural Machine Translation Toolkit
  ☆179Updated 4 months ago
• google-research-datasets / indic-gen-bench
  IndicGenBench is a high-quality, multilingual, multi-way parallel benchmark for evaluating Large Language Models (LLMs) on 4 user-facing …
  ☆49Updated 10 months ago
• BPYap / BERT-WSD
  [EMNLP-Findings 2020] Adapting BERT for Word Sense Disambiguation with Gloss Selection Objective and Example Sentences
  ☆63Updated last year
• AI4Bharat / Shoonya
  Shoonya - Platform to Annotate and label data at scale.
  ☆55Updated 10 months ago