nateraw / huggingface-datasets-converter
Scripts to convert datasets from various sources to Hugging Face Datasets.
β57Updated 2 years ago
Related projects β
Alternatives and complementary repositories for huggingface-datasets-converter
- Using short models to classify long textsβ20Updated last year
- [WIP] A π₯ interface for running code in the cloudβ86Updated last year
- NLP Examples using the π€ librariesβ42Updated 3 years ago
- Consists of the largest (10K) human annotated code-switched semantic parsing dataset & 170K generated utterance using the CST5 augmentatiβ¦β33Updated last year
- π€ Disaggregators: Curated data labelers for in-depth analysis.β65Updated last year
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.β92Updated last year
- β19Updated 3 years ago
- An extension package of π€ Datasets that provides support for executing arbitrary SQL queries on HF datasetsβ31Updated 9 months ago
- β13Updated last year
- β28Updated last year
- Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP modelsβ¦β37Updated 2 years ago
- ππ€ A collection of templates for Hugging Face Spacesβ35Updated last year
- A library for squeakily cleaning and filtering language datasets.β45Updated last year
- A Python library aimed at dissecting and augmenting NER training data.β56Updated last year
- Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborationsβ14Updated 2 years ago
- β20Updated last year
- Examples using π€ Hub to share and reload machine learning modelsβ33Updated 2 years ago
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy modβ¦β15Updated last year
- classy is a simple-to-use library for building high-performance Machine Learning models in NLP.β85Updated last month
- π€ HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)β17Updated 8 months ago
- Tutorial to pretrain & fine-tune a π€ Flax T5 model on a TPUv3-8 with GCPβ58Updated 2 years ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.β32Updated 2 months ago
- π€ Trade any tensors over the networkβ30Updated last year
- Embedding Recycling for Language modelsβ38Updated last year
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/β¦β23Updated 7 months ago
- β30Updated 2 years ago
- **ARCHIVED** Filesystem interface to π€ Hubβ56Updated last year
- β86Updated 2 years ago
- π οΈ Tools for Transformers compression using PyTorch Lightning β‘β79Updated last week
- Code for the paper: Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queriesβ19Updated 2 years ago