huggingface / datasetsLinks
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
☆20,921Updated this week
Alternatives and similar repositories for datasets
Users that are interested in datasets are comparing it to the libraries listed below
Sorting:
- 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal model…☆153,203Updated this week
- 💥 Fast State-of-the-Art Tokenizers optimized for Research and Production☆10,252Updated this week
- Unsupervised text tokenizer for Neural Network-based text generation.☆11,474Updated last week
- 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…☆9,329Updated this week
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆21,851Updated 5 months ago
- Repo for external large-scale work☆6,548Updated last year
- Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"☆6,455Updated 3 weeks ago
- State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enter…☆14,602Updated last year
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆40,890Updated last week
- State-of-the-Art Text Embeddings☆17,942Updated last week
- Ongoing research training transformer models at scale☆14,389Updated this week
- Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.☆30,530Updated last week
- A framework for training and evaluating AI models on a variety of openly available dialogue datasets.☆10,625Updated 2 years ago
- Trax — Deep Learning with Clear Code and Speed☆8,295Updated 2 months ago
- BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)☆7,797Updated 6 months ago
- Notebooks using the Hugging Face libraries 🤗☆4,388Updated this week
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆32,008Updated 2 months ago
- 🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization…☆3,192Updated 2 weeks ago
- Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conve…☆4,229Updated 3 months ago
- Google Research☆36,832Updated this week
- Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the mo…☆22,966Updated last year
- An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries☆7,343Updated 2 months ago
- An open-source NLP research library, built on PyTorch.☆11,887Updated 3 years ago
- The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.☆10,576Updated last week
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆20,157Updated last week
- The Learning Interpretability Tool: Interactively analyze ML models to understand their behavior in an extensible and framework agnostic …☆3,614Updated this week
- Public repo for HF blog posts☆3,212Updated this week
- GPT-3: Language Models are Few-Shot Learners☆15,778Updated 5 years ago
- 🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.☆31,812Updated this week
- ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator☆18,504Updated this week