huggingface / disaggregators
🤗 Disaggregators: Curated data labelers for in-depth analysis.
☆65Updated last year
Related projects ⓘ
Alternatives and complementary repositories for disaggregators
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆92Updated last year
- Embedding Recycling for Language models☆38Updated last year
- Using short models to classify long texts☆20Updated last year
- A library for squeakily cleaning and filtering language datasets.☆45Updated last year
- A Python library aimed at dissecting and augmenting NER training data.☆56Updated last year
- Source code and data for Like a Good Nearest Neighbor☆28Updated 9 months ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated last year
- [WIP] A 🔥 interface for running code in the cloud☆86Updated last year
- Versatile framework designed to streamline the integration of your models, as well as those sourced from Hugging Face, into complex progr…☆23Updated 3 months ago
- Scripts to convert datasets from various sources to Hugging Face Datasets.☆57Updated 2 years ago
- Developing tools to automatically analyze datasets☆70Updated 3 weeks ago
- ☆24Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆23Updated 8 months ago
- Command Line Interface for Hugging Face Inference Endpoints☆66Updated 7 months ago
- Ranking of fine-tuned HF models as base models.☆35Updated last year
- ☆75Updated last year
- 🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)☆17Updated 8 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆40Updated 8 months ago
- ☆46Updated this week
- No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval☆27Updated 2 years ago
- minimal pytorch implementation of bm25 (with sparse tensors)☆90Updated 8 months ago
- Generalist and Lightweight Model for Text Classification☆49Updated this week
- Experiments with generating opensource language model assistants☆97Updated last year
- RATransformers 🐭- Make your transformer (like BERT, RoBERTa, GPT-2 and T5) Relation Aware!☆41Updated last year
- NLP with Rust for Python 🦀🐍☆59Updated 5 months ago
- 🤝 Trade any tensors over the network☆30Updated last year
- **ARCHIVED** Filesystem interface to 🤗 Hub☆56Updated last year
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated last year