Alternatives and similar repositories for gaia

Users that are interested in gaia are comparing it to the libraries listed below

• huggingface / data-measurements-tool
  Developing tools to automatically analyze datasets
  ☆75Updated last year
• salesforce / simplification
  ☆23Updated 11 months ago
• huggingface / disaggregators
  🤗 Disaggregators: Curated data labelers for in-depth analysis.
  ☆67Updated 2 years ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆20Updated 11 months ago
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆44Updated 2 years ago
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆32Updated 2 years ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆27Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated 2 years ago
• huggingface / hf-endpoints-emulator
  Local emulator for Hugging Face Inference Endpoints customer handlers
  ☆27Updated 2 years ago
• stanfordnlp / multi-distribution-retrieval
  Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval
  ☆15Updated last year
• EleutherAI / semantic-memorization
  ☆44Updated last year
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 3 years ago
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆49Updated 2 years ago
• luohongyin / EntST
  Entailment self-training
  ☆25Updated 2 years ago
• lucy3 / whos_filtered
  ☆14Updated last year
• nateraw / spaces-docker-templates
  🚀🤗 A collection of templates for Hugging Face Spaces
  ☆35Updated 2 years ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆96Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆49Updated 2 years ago
• stas00 / porting
  Helper scripts and notes that were used while porting various nlp models
  ☆48Updated 3 years ago
• allenai / decon
  decontamination
  ☆21Updated last month
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆20Updated last year
• huggingface / datasets-tagging
  A Streamlit app to add structured tags to a dataset card
  ☆22Updated 3 years ago
• prateeky2806 / ComPEFT
  ☆26Updated 2 years ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆35Updated 2 years ago
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆33Updated 11 months ago
• liujch1998 / infini-gram
  ☆89Updated last month
• EleutherAI / best-download
  URL downloader supporting checkpointing and continuous checksumming.
  ☆19Updated 2 years ago
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated 2 years ago
• EleutherAI / stackexchange-dataset
  Python tools for processing the stackexchange data dumps into a text dataset for Language Models
  ☆85Updated 2 years ago