huggingface / datasets
🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
☆19,819Updated this week
Alternatives and similar repositories for datasets:
Users that are interested in datasets are comparing it to the libraries listed below
- 💥 Fast State-of-the-Art Tokenizers optimized for Research and Production☆9,509Updated this week
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆31,179Updated 2 months ago
- 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.☆141,466Updated this week
- 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…☆8,497Updated last week
- State-of-the-Art Text Embeddings☆16,265Updated this week
- An open-source NLP research library, built on PyTorch.☆11,826Updated 2 years ago
- Unsupervised text tokenizer for Neural Network-based text generation.☆10,707Updated 3 weeks ago
- Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"☆6,302Updated 3 weeks ago
- Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the mo…☆22,822Updated 7 months ago
- Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more☆31,708Updated this week
- 💫 Industrial-strength Natural Language Processing (NLP) in Python☆31,175Updated last month
- A library for efficient similarity search and clustering of dense vectors.☆33,821Updated this week
- A very simple framework for state-of-the-art Natural Language Processing (NLP)☆14,112Updated this week
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,423Updated last month
- BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)☆7,237Updated last year
- Pretrain, finetune ANY AI model of ANY size on multiple GPUs, TPUs with zero code changes.☆29,161Updated this week
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆21,600Updated 7 months ago
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆17,837Updated this week
- Label Studio is a multi-type data labeling and annotation tool with standardized output format☆21,293Updated this week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆37,533Updated this week
- Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conve…☆4,162Updated 9 months ago
- Trax — Deep Learning with Clear Code and Speed☆8,177Updated last month
- Train transformer language models with reinforcement learning.☆12,591Updated this week
- A framework for training and evaluating AI models on a variety of openly available dialogue datasets.☆10,516Updated last year
- State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enter…☆14,058Updated 7 months ago
- A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used …☆17,054Updated this week
- A system for quickly generating training data with weak supervision☆5,840Updated 10 months ago
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,184Updated last year
- Flax is a neural network library for JAX that is designed for flexibility.☆6,421Updated this week
- TensorFlow code and pre-trained models for BERT☆38,882Updated 7 months ago