huggingface / datasetsLinks
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
☆20,976Updated last week
Alternatives and similar repositories for datasets
Users that are interested in datasets are comparing it to the libraries listed below
Sorting:
- 💥 Fast State-of-the-Art Tokenizers optimized for Research and Production☆10,301Updated 2 weeks ago
- Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.☆30,561Updated last week
- 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…☆9,377Updated last week
- 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal model…☆153,866Updated this week
- Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more☆34,299Updated this week
- State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enter…☆14,630Updated last year
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆41,015Updated this week
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆32,020Updated 2 months ago
- 🦉 Data Versioning and ML Experiments☆15,202Updated this week
- Unsupervised text tokenizer for Neural Network-based text generation.☆11,508Updated this week
- A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Auto…☆16,271Updated this week
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)☆9,312Updated 3 weeks ago
- A hyperparameter optimization framework☆13,217Updated this week
- This repository contains implementations and illustrative code to accompany DeepMind publications☆14,552Updated last week
- A very simple framework for state-of-the-art Natural Language Processing (NLP)☆14,333Updated last month
- Trax — Deep Learning with Clear Code and Speed☆8,294Updated 2 months ago
- 🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.☆32,045Updated this week
- The fastai deep learning library☆27,719Updated this week
- The open source developer platform to build AI agents and models with confidence. Enhance your AI applications with end-to-end tracking, …☆23,329Updated this week
- Hydra is a framework for elegantly configuring complex applications☆10,036Updated last week
- Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the mo…☆22,972Updated last year
- Google Research☆36,886Updated this week
- GPT-3: Language Models are Few-Shot Learners☆15,775Updated 5 years ago
- Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!☆40,937Updated this week
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆21,875Updated 5 months ago
- Natural Language Processing Best Practices & Examples☆6,442Updated 3 years ago
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆16,788Updated 2 months ago
- Flax is a neural network library for JAX that is designed for flexibility.☆6,977Updated this week
- Low-code framework for building custom LLMs, neural networks, and other AI models☆11,630Updated last week
- AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file convert…☆23,593Updated last week