Alternatives and similar repositories for nadir:

Users that are interested in nadir are comparing it to the libraries listed below

• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• euclaise / supertrainer2000
  ☆49Updated last year
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆42Updated last year
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆61Updated last year
• KaiNylund / lm-weights-encode-time
  ☆67Updated 8 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 7 months ago
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆44Updated 10 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆62Updated 10 months ago
• google-research / jestimator
  Amos optimizer with JEstimator lib.
  ☆82Updated 11 months ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆82Updated last year
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆53Updated last year
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆26Updated last year
• rasbt / nn_plus_gzip
  Gzip and nearest neighbors for text classification
  ☆56Updated last year
• ChrisHayduk / QLoRA-for-MLM
  QLoRA for Masked Language Modeling
  ☆22Updated last year
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆37Updated 2 years ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆49Updated last year
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated 2 years ago
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆36Updated last year
• yash-srivastava19 / arrakis
  Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.
  ☆28Updated this week
• wolfecameron / lora_instruction_tune
  ☆40Updated 11 months ago
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆77Updated 3 years ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆80Updated 3 years ago
• nateraw / huggingface-datasets-converter
  Scripts to convert datasets from various sources to Hugging Face Datasets.
  ☆57Updated 2 years ago