Alternatives and similar repositories for nadir:

Users that are interested in nadir are comparing it to the libraries listed below

• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 6 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 6 months ago
• euclaise / supertrainer2000
  ☆49Updated last year
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆51Updated 11 months ago
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago
• huggingface / bloom-jax-inference
  ☆67Updated 2 years ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆81Updated last year
• young-geng / mlxu
  Machine Learning eXperiment Utilities
  ☆46Updated 9 months ago
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆37Updated 2 years ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆49Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆59Updated last year
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated 11 months ago
• sholtodouglas / scalingExperiments
  ☆60Updated 3 years ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆80Updated 3 years ago
• yash-srivastava19 / arrakis
  Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.
  ☆26Updated 3 weeks ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆83Updated last month
• cat-state / tinypar
  ☆20Updated last year
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• srush / anynp
  Proof-of-concept of global switching between numpy/jax/pytorch in a library.
  ☆18Updated 9 months ago
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆53Updated last year
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆77Updated 3 years ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• CarperAI / treasure_trove
  ☆22Updated last year
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated last year
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆61Updated last year
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated 2 years ago
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆69Updated 2 years ago
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆36Updated last year