huggingface / datasetsLinks
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
☆20,801Updated last week
Alternatives and similar repositories for datasets
Users that are interested in datasets are comparing it to the libraries listed below
Sorting:
- 💥 Fast State-of-the-Art Tokenizers optimized for Research and Production☆10,206Updated 3 weeks ago
- 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…☆9,256Updated 2 weeks ago
- Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.☆30,382Updated this week
- Unsupervised text tokenizer for Neural Network-based text generation.☆11,411Updated this week
- 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal model…☆151,997Updated this week
- An open-source NLP research library, built on PyTorch.☆11,882Updated 2 years ago
- A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Auto…☆16,017Updated last week
- Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data …☆11,062Updated 3 weeks ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆31,918Updated last month
- A very simple framework for state-of-the-art Natural Language Processing (NLP)☆14,316Updated last week
- Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stre…☆8,878Updated 2 weeks ago
- Ongoing research training transformer models at scale☆14,082Updated this week
- Code for the paper "Language Models are Unsupervised Multitask Learners"☆24,338Updated last year
- Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!☆40,389Updated this week
- 💫 Industrial-strength Natural Language Processing (NLP) in Python☆32,758Updated last week
- Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conve…☆4,222Updated 2 months ago
- Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more☆33,852Updated last week
- BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)☆7,731Updated 5 months ago
- Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"☆6,446Updated 6 months ago
- Streamlit — A faster way to build and share data apps.☆42,035Updated this week
- 📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.☆28,482Updated last year
- The official Python client for the Hugging Face Hub.☆3,030Updated this week
- Google Research☆36,659Updated last week
- Data augmentation for NLP☆4,627Updated last year
- Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages☆7,642Updated this week
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆16,404Updated last month
- State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enter…☆14,542Updated last year
- A library for efficient similarity search and clustering of dense vectors.☆37,735Updated last week
- The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!☆8,172Updated last week
- 🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.☆31,453Updated this week