huggingface / data-measurements-tool
Developing tools to automatically analyze datasets
β74Updated 4 months ago
Alternatives and similar repositories for data-measurements-tool:
Users that are interested in data-measurements-tool are comparing it to the libraries listed below
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 laβ¦β46Updated last year
- π€ Disaggregators: Curated data labelers for in-depth analysis.β65Updated 2 years ago
- **ARCHIVED** Filesystem interface to π€ Hubβ58Updated last year
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found heβ¦β31Updated last year
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.β93Updated 2 years ago
- Open source library for few shot NLPβ77Updated last year
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)β60Updated last year
- β65Updated last year
- No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrievalβ28Updated 2 years ago
- A library for squeakily cleaning and filtering language datasets.β46Updated last year
- Plug-and-play Search Interfaces with Pyserini and Hugging Faceβ31Updated last year
- β19Updated 3 months ago
- β29Updated last year
- Tools for managing datasets for governance and training.β82Updated 3 weeks ago
- Embedding Recycling for Language modelsβ38Updated last year
- β35Updated last year
- Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."β63Updated last year
- β44Updated 3 months ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning Pβ¦β34Updated last year
- Using short models to classify long textsβ21Updated last year
- Experiments with generating opensource language model assistantsβ97Updated last year
- Transformers at any scaleβ41Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked promptsβ24Updated 11 months ago
- Finding semantically meaningful and accurate prompts.β46Updated last year
- β77Updated last year
- π€ Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.β82Updated 2 years ago
- Supercharge huggingface transformers with model parallelism.β76Updated 4 months ago
- [EACL 2023] CoTEVer: Chain of Thought Prompting Annotation Toolkit for Explanation Verificationβ38Updated last year
- An instruction-based benchmark for text improvements.β141Updated 2 years ago
- Python tools for processing the stackexchange data dumps into a text dataset for Language Modelsβ81Updated last year