Alternatives and similar repositories for curated-transformers

Users that are interested in curated-transformers are comparing it to the libraries listed below

• PiotrNawrot / nanoT5
  Fast & Simple repository for pre-training and fine-tuning T5-style models
  ☆1,004Updated 9 months ago
• alasdairforsythe / tokenmonster
  Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript
  ☆581Updated 11 months ago
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆711Updated last year
• JonasGeiping / cramming
  Cramming the training of a (BERT-type) language model into limited compute.
  ☆1,332Updated 11 months ago
• raphaelsty / neural-cherche
  Neural Search
  ☆356Updated 2 months ago
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆347Updated 2 years ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆697Updated last year
• HazyResearch / meerkat
  Creative interactive views of any dataset.
  ☆838Updated 5 months ago
• pbelcak / UltraFastBERT
  The repository for the code of the UltraFastBERT paper
  ☆514Updated last year
• srush / raspy
  An interactive exploration of Transformer programming.
  ☆264Updated last year
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆473Updated 2 years ago
• allenai / tango
  Organize your experiments into discrete steps that can be cached and reused throughout the lifetime of your research project.
  ☆561Updated last year
• HazyResearch / H3
  Language Modeling with the H3 State Space Model
  ☆518Updated last year
• r2d4 / rellm
  Exact structure out of any language model completion.
  ☆509Updated last year
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆1,048Updated last year
• koaning / embetter
  just a bunch of useful embeddings for scikit-learn pipelines
  ☆499Updated 2 months ago
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆287Updated 5 months ago
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆267Updated 3 weeks ago
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆498Updated last year
• tysam-code / hlb-gpt
  Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…
  ☆345Updated 10 months ago
• abertsch72 / unlimiformer
  Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"
  ☆1,059Updated last year
• SkunkworksAI / hydra-moe
  ☆412Updated last year
• evanmiller / LLM-Reading-List
  LLM papers I'm reading, mostly on inference and model compression
  ☆729Updated last year
• r-three / git-theta
  git extension for {collaborative, communal, continual} model development
  ☆212Updated 6 months ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆196Updated last year
• kyegomez / Sophia
  Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
  ☆380Updated 11 months ago
• carlini / yet-another-applied-llm-benchmark
  A benchmark to evaluate language models on questions I've previously asked them to solve.
  ☆1,011Updated last month
• HazyResearch / safari
  Convolutions for Sequence Modeling
  ☆883Updated 11 months ago
• mlfoundations / open_lm
  A repository for research on medium sized language models.
  ☆495Updated 3 weeks ago
• srush / MiniChain
  A tiny library for coding with large language models.
  ☆1,232Updated 10 months ago