nateraw / huggingface-datasets-converterLinks
Scripts to convert datasets from various sources to Hugging Face Datasets.
β57Updated 2 years ago
Alternatives and similar repositories for huggingface-datasets-converter
Users that are interested in huggingface-datasets-converter are comparing it to the libraries listed below
Sorting:
- [WIP] A π₯ interface for running code in the cloudβ85Updated 2 years ago
- π€ Disaggregators: Curated data labelers for in-depth analysis.β67Updated 2 years ago
- Using short models to classify long textsβ21Updated 2 years ago
- ππ€ A collection of templates for Hugging Face Spacesβ35Updated last year
- NLP Examples using the π€ librariesβ40Updated 4 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.β95Updated 2 years ago
- **ARCHIVED** Filesystem interface to π€ Hubβ58Updated 2 years ago
- Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborationsβ14Updated 3 years ago
- Build fast gradio demos of fastai learnersβ35Updated 4 years ago
- Developing tools to automatically analyze datasetsβ75Updated 11 months ago
- π οΈ Tools for Transformers compression using PyTorch Lightning β‘β85Updated this week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.β33Updated 2 weeks ago
- Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP modelsβ¦β37Updated 3 years ago
- β28Updated 2 years ago
- Comprehensive NLP Evaluation Systemβ188Updated last year
- Command Line Interface for Hugging Face Inference Endpointsβ66Updated last year
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy modβ¦β15Updated 2 years ago
- Examples using π€ Hub to share and reload machine learning modelsβ32Updated 2 years ago
- This project shows how to derive the total number of training tokens from a large text dataset from π€ datasets with Apache Beam and Dataβ¦β27Updated 2 years ago
- TorchServe+Streamlit for easily serving your HuggingFace NER modelsβ33Updated 3 years ago
- A library for squeakily cleaning and filtering language datasets.β46Updated 2 years ago
- Contains Colab Notebooks show cool use-cases of different GCP ML APIs.β10Updated 4 years ago
- Streamlit demo app to demonstrate the features of transformers interpret with multiple models.β25Updated 4 years ago
- Ranking of fine-tuned HF models as base models.β36Updated 2 weeks ago
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and teβ¦β44Updated last year
- Sequence models in Numpyβ25Updated 4 years ago
- Tutorial to pretrain & fine-tune a π€ Flax T5 model on a TPUv3-8 with GCPβ58Updated 3 years ago
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)β61Updated 2 years ago
- A sample pattern for running CI tests on Modalβ17Updated 5 months ago
- β33Updated 2 years ago