masakhane-io / masakhanePreprocessorLinks
Building an effective preprocessing tool for African languages
☆13Updated 2 years ago
Alternatives and similar repositories for masakhanePreprocessor
Users that are interested in masakhanePreprocessor are comparing it to the libraries listed below
Sorting:
- Data, Embeddings, Stopword lists, code, and baselines for COLING 2020 paper titled "KINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text …☆13Updated last year
- MasakhaNEWS: News Topic Classification for African Languages☆24Updated last year
- Crosslingual Question Answering for African Languages☆30Updated last year
- This is a repository for NaijaSenti. A Lacuna Funded Project for the development of sentiment corpus for four Nigerian languages: Igbo, H…☆35Updated 3 months ago
- AfriBERTa: Exploring the Viability of Pretrained Multilingual Language Models for Low-resourced Languages☆80Updated 3 years ago
- A collection of textual datasets in Hausa language and the corresponding translation in English language.☆16Updated 4 years ago
- Mining Legal Arguments in Court Decisions - Data and software☆73Updated 2 years ago
- A curated list of materials on AI guardrails☆44Updated 7 months ago
- A simple library for segmenting legal texts☆17Updated 2 years ago
- ☆12Updated last year
- LexGLUE: A Benchmark Dataset for Legal Language Understanding in English☆234Updated 6 months ago
- Streamlit app to Translate text to or between 50 languages with mBART-50 from Huggingface and Facebook☆25Updated 4 years ago
- Transforming textual descriptions into process models using deep learning☆15Updated 6 years ago
- MAFAND-MT☆60Updated last year
- COMET for African languages☆10Updated last year
- NeatText a simple NLP package for cleaning textual data and text preprocessing☆75Updated 2 years ago
- Repository containing awesome resources regarding Hugging Face tooling.☆48Updated 2 years ago
- POS for African languages☆19Updated 7 months ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆75Updated last year
- A repository for publicly/freely available Natural Language Processing (NLP) datasets for African languages.☆112Updated last year
- Synthetic Text Dataset Generation for LLM projects☆55Updated 2 months ago
- Semantic Segmentation of Legal texts that labels sentences with one of 7 rhetorical roles.☆78Updated last year
- A dataset for pretraining language models targeted for legal tasks.☆141Updated 3 years ago
- LegalCrawler: A tool for automated scraping of English legal corpora☆59Updated 3 years ago
- [EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.☆111Updated last year
- A large scale Humor Dataset, containing more than 550k rated English jokes (LREC'20)☆73Updated 2 years ago
- Legal document similarity - Code, data, and models for the ICAIL 2021 paper "Evaluating Document Representations for Content-based Legal …☆32Updated 4 years ago
- Python intefrace for evaluation on chatgpt models☆19Updated last year
- Pinecone text client library☆66Updated 5 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆72Updated last year