huggingface / datasetsLinks
π€ The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
β21,042Updated 2 weeks ago
Alternatives and similar repositories for datasets
Users that are interested in datasets are comparing it to the libraries listed below
Sorting:
- π₯ Fast State-of-the-Art Tokenizers optimized for Research and Productionβ10,349Updated 3 weeks ago
- Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.β30,657Updated last week
- π A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (iβ¦β9,415Updated 3 weeks ago
- π€ Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal modelβ¦β154,558Updated this week
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.β32,065Updated 3 months ago
- Google Researchβ36,986Updated this week
- The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.β10,702Updated this week
- Ongoing research training transformer models at scaleβ14,798Updated this week
- Build and share delightful machine learning apps, all in Python. π Star to support our work!β41,190Updated 2 weeks ago
- Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and moreβ34,475Updated this week
- Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languagesβ7,703Updated this week
- A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Autoβ¦β16,395Updated this week
- Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Streβ¦β8,970Updated this week
- A hyperparameter optimization frameworkβ13,315Updated this week
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalitiesβ21,920Updated 3 weeks ago
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.β14,644Updated last month
- π« Industrial-strength Natural Language Processing (NLP) in Pythonβ33,032Updated last month
- π¦ Data Versioning and ML Experimentsβ15,229Updated last week
- Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"β6,468Updated 2 months ago
- Unsupervised text tokenizer for Neural Network-based text generation.β11,558Updated this week
- Low-code framework for building custom LLMs, neural networks, and other AI modelsβ11,638Updated 3 weeks ago
- βοΈ Build multimodal AI applications with cloud-native stackβ21,819Updated 9 months ago
- Repo for external large-scale workβ6,547Updated last year
- NLTK Sourceβ14,447Updated this week
- TensorFlow's Visualization Toolkitβ7,082Updated 2 weeks ago
- Hackable and optimized Transformers building blocks, supporting a composable construction.β10,240Updated last week
- A library for efficient similarity search and clustering of dense vectors.β38,613Updated last week
- An open-source NLP research library, built on PyTorch.β11,885Updated 3 years ago
- π€ Evaluate: A library for easily evaluating machine learning models and datasets.β2,388Updated last month
- π€ Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.β32,300Updated this week