masakhane-io / masakhanePreprocessorLinks
Building an effective preprocessing tool for African languages
☆13Updated last year
Alternatives and similar repositories for masakhanePreprocessor
Users that are interested in masakhanePreprocessor are comparing it to the libraries listed below
Sorting:
- Data, Embeddings, Stopword lists, code, and baselines for COLING 2020 paper titled "KINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text …☆13Updated last year
- MasakhaNEWS: News Topic Classification for African Languages☆24Updated last year
- AfriBERTa: Exploring the Viability of Pretrained Multilingual Language Models for Low-resourced Languages☆78Updated 3 years ago
- Crosslingual Question Answering for African Languages☆30Updated last year
- POS for African languages☆19Updated 5 months ago
- List of all the resources I developed in collaboration with LSV and Masakhane during my doctoral studies and beyond☆12Updated 3 years ago
- MAFAND-MT☆59Updated last year
- Transforming textual descriptions into process models using deep learning☆15Updated 6 years ago
- This is a repository for NaijaSenti. A Lacuna Funded Project for the development of sentiment corpus for four Nigerian languages: Igbo, H…☆35Updated last month
- COMET for African languages☆10Updated 10 months ago
- A dataset for pretraining language models targeted for legal tasks.☆140Updated 3 years ago
- GPTNERMED is a language model-generated, synthetic dataset and an open neural NER model for medical entities designed for German data.☆16Updated 2 years ago
- Transformers for Clinical NLP☆25Updated 3 months ago
- Repository containing awesome resources regarding Hugging Face tooling.☆48Updated last year
- Versatile framework designed to streamline the integration of your models, as well as those sourced from Hugging Face, into complex progr…☆34Updated 3 months ago
- A simple library for segmenting legal texts☆17Updated 2 years ago
- Learning PyTorch through the D2L book. A series of notebooks for the same☆27Updated 3 years ago
- A Python package to get useful information from documents using TopicRank Algorithm.☆16Updated 2 years ago
- NuNER is the family of SOTA Foundation and Zero-shot for Entity Recognition☆14Updated last year
- GLiNER model in a FastAPI microservice.☆45Updated 11 months ago
- Public runnable examples of using John Snow Labs' OCR for Apache Spark.☆93Updated last week
- NeatText a simple NLP package for cleaning textual data and text preprocessing☆73Updated last year
- Chunk your text using gpt4o-mini more accurately☆44Updated last year
- A collection of textual datasets in Hausa language and the corresponding translation in English language.☆16Updated 4 years ago
- OpenNyAI is a mission aimed at developing open source software and datasets to catalyze the creation of AI-powered solutions to improve a…☆85Updated last year
- Streamlit app to Translate text to or between 50 languages with mBART-50 from Huggingface and Facebook☆25Updated 4 years ago
- Legal document similarity - Code, data, and models for the ICAIL 2021 paper "Evaluating Document Representations for Content-based Legal …☆32Updated 4 years ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆75Updated last year
- Semantic Segmentation of Legal texts that labels sentences with one of 7 rhetorical roles.☆78Updated last year
- A curated list of materials on AI guardrails☆43Updated 5 months ago