bigscience-workshop / data_sourcingLinks
This directory gathers the tools developed by the Data Sourcing Working Group
☆31Updated 4 years ago
Alternatives and similar repositories for data_sourcing
Users that are interested in data_sourcing are comparing it to the libraries listed below
Sorting:
- Scripts to convert datasets from various sources to Hugging Face Datasets.☆57Updated 3 years ago
- Transcribing audio files using Hugging Face's implementation of Wav2Vec2 + "chain-linking" NLP tasks to combine speech-to-text with downs…☆32Updated 4 years ago
- A library to synthesize text datasets using Large Language Models (LLM)☆152Updated 3 years ago
- Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.☆127Updated 5 years ago
- A minimal template for creating a pypi package☆49Updated 5 years ago
- A PyTorch Lightning Callback for pushing models to the Hugging Face Hub 🤗⚡️☆35Updated 3 years ago
- A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models☆30Updated 4 years ago
- Small repo describing how to use Hugging Face's Wav2Vec2 with PyCTCDecode☆111Updated 3 years ago
- A PyPI package for easy text annotation in a Jupyter Notebook.☆29Updated 4 years ago
- This is the second part of the Deep Learning Course for the Master in High-Performance Computing (SISSA/ICTP).)☆33Updated 5 years ago
- xfspell — the Transformer Spell Checker☆189Updated 5 years ago
- Viewer for the 🤗 datasets library.☆86Updated 4 years ago
- Execute arbitrary SQL queries on 🤗 Datasets☆32Updated 2 years ago
- Explainable Zero-Shot Topic Extraction☆65Updated last year
- Few-shot Named Entity Recognition☆121Updated 3 years ago
- Examples using 🤗 Hub to share and reload machine learning models☆32Updated 3 years ago
- Some notebooks for NLP☆207Updated 2 years ago
- classy is a simple-to-use library for building high-performance Machine Learning models in NLP.☆87Updated 3 weeks ago
- An easy-to-use Python module that helps you to extract the BERT embeddings for a large text dataset (Bengali/English) efficiently.☆36Updated 2 years ago
- Dataset of sentences from Hindi stories tagged with different emotion tags☆11Updated 6 years ago
- Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP models…☆37Updated 3 years ago
- Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".☆99Updated 3 years ago
- ☆117Updated 3 months ago
- fastai ulmfit - Pretraining the Language Model, Fine-Tuning and training a Classifier☆32Updated 3 years ago
- Asent is a python library for performing efficient and transparent sentiment analysis using spaCy.☆120Updated 3 months ago
- A repository for publicly/freely available Natural Language Processing (NLP) datasets for African languages.☆112Updated last year
- Augmenty is an augmentation library based on spaCy for augmenting texts.☆156Updated last year
- TimeLMs: Diachronic Language Models from Twitter☆112Updated last year
- ☆87Updated 3 years ago
- Accurate word segmentation for hashtags and text, powered by Transformers and Beam Search. A scalable alternative to heuristic splitters …☆76Updated 3 weeks ago