huggingface / hf_benchmarksLinks
A starter kit for evaluating benchmarks on the π€ Hub
β15Updated 2 years ago
Alternatives and similar repositories for hf_benchmarks
Users that are interested in hf_benchmarks are comparing it to the libraries listed below
Sorting:
- A Streamlit app to add structured tags to a dataset cardβ22Updated 3 years ago
- β34Updated 3 years ago
- [WIP] A π₯ interface for running code in the cloudβ86Updated 2 years ago
- π€ Disaggregators: Curated data labelers for in-depth analysis.β67Updated 2 years ago
- β66Updated 3 years ago
- Local emulator for Hugging Face Inference Endpoints customer handlersβ27Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.β96Updated 2 years ago
- A case study of efficient training of large language models using commodity hardware.β68Updated 3 years ago
- The package used to build the documentation of our Hugging Face reposβ135Updated this week
- **ARCHIVED** Filesystem interface to π€ Hubβ58Updated 2 years ago
- Blazing fast training of π€ Transformers on Graphcore IPUsβ87Updated last year
- Developing tools to automatically analyze datasetsβ75Updated last year
- Hugging Face and Pyserini interoperabilityβ19Updated 2 years ago
- Serialize JAX, Flax, Haiku, or Objax model params with π€`safetensors`β47Updated last year
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)β190Updated 3 years ago
- Train fastai models faster (and other useful tools)β72Updated 7 months ago
- Scripts to convert datasets from various sources to Hugging Face Datasets.β57Updated 3 years ago
- Techniques used to run BLOOM at inference in parallelβ37Updated 3 years ago
- ML/DL Math and Method notesβ66Updated 2 years ago
- MinT: Minimal Transformer Library and Tutorialsβ260Updated 3 years ago
- β19Updated last year
- β87Updated 3 years ago
- HomebrewNLP in JAX flavour for maintable TPU-Trainingβ51Updated 2 years ago
- Amos optimizer with JEstimator lib.β82Updated last year
- β16Updated 3 years ago
- This project shows how to derive the total number of training tokens from a large text dataset from π€ datasets with Apache Beam and Dataβ¦β27Updated 3 years ago
- Reads arXiv papers using Text-to-Speechβ63Updated 2 years ago
- Pipeline for pulling and processing online language model pretraining data from the webβ177Updated 2 years ago
- Common Python utilities and GitHub Actions in Lightning Ecosystemβ63Updated this week
- β102Updated 2 weeks ago