nateraw / huggingface-datasets-converter
Scripts to convert datasets from various sources to Hugging Face Datasets.
β57Updated 2 years ago
Alternatives and similar repositories for huggingface-datasets-converter:
Users that are interested in huggingface-datasets-converter are comparing it to the libraries listed below
- π€ Disaggregators: Curated data labelers for in-depth analysis.β65Updated 2 years ago
- NLP Examples using the π€ librariesβ41Updated 4 years ago
- [WIP] A π₯ interface for running code in the cloudβ85Updated 2 years ago
- Execute arbitrary SQL queries on π€ Datasetsβ32Updated last year
- Using short models to classify long textsβ21Updated 2 years ago
- Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP modelsβ¦β36Updated 3 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.β93Updated 2 years ago
- β28Updated 2 years ago
- Tutorial to pretrain & fine-tune a π€ Flax T5 model on a TPUv3-8 with GCPβ58Updated 2 years ago
- A PyTorch Lightning Callback for pushing models to the Hugging Face Hub π€β‘οΈβ36Updated 2 years ago
- ππ€ A collection of templates for Hugging Face Spacesβ35Updated last year
- β19Updated 2 years ago
- π οΈ Tools for Transformers compression using PyTorch Lightning β‘β83Updated 5 months ago
- classy is a simple-to-use library for building high-performance Machine Learning models in NLP.β87Updated 3 weeks ago
- Build fast gradio demos of fastai learnersβ35Updated 3 years ago
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy modβ¦β15Updated 2 years ago
- Command Line Interface for Hugging Face Inference Endpointsβ66Updated last year
- π€ HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)β17Updated last year
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/β¦β26Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.β34Updated 4 months ago
- A Python library aimed at dissecting and augmenting NER training data.β58Updated last year
- MultiOCR, an interface that connects multiple open-source OCR and various Cloud OCR.β31Updated last year
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning Pβ¦β34Updated last year
- Explainable Zero-Shot Topic Extractionβ62Updated 8 months ago
- Code for the paper: Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queriesβ19Updated 3 years ago
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and teβ¦β42Updated last year
- Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborationsβ14Updated 2 years ago
- β13Updated 2 years ago
- A spaCy custom component that extracts and normalizes temporal expressionsβ54Updated 2 years ago
- An easy-to-use Python module that helps you to extract the BERT embeddings for a large text dataset (Bengali/English) efficiently.β36Updated last year