explosion / curated-transformers

Related projects ⓘ

Alternatives and complementary repositories for curated-transformers

• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆894Updated 9 months ago
• alasdairforsythe / tokenmonster
  Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript
  ☆550Updated 4 months ago
• PiotrNawrot / nanoT5
  Fast & Simple repository for pre-training and fine-tuning T5-style models
  ☆968Updated 2 months ago
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆702Updated last year
• HazyResearch / meerkat
  Creative interactive views of any dataset.
  ☆829Updated 8 months ago
• pbelcak / UltraFastBERT
  The repository for the code of the UltraFastBERT paper
  ☆514Updated 7 months ago
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆323Updated last year
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆667Updated 6 months ago
• koaning / embetter
  just a bunch of useful embeddings
  ☆466Updated last month
• raphaelsty / neural-cherche
  Neural Search
  ☆343Updated 5 months ago
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆706Updated last month
• allenai / tango
  Organize your experiments into discrete steps that can be cached and reused throughout the lifetime of your research project.
  ☆532Updated 5 months ago
• abertsch72 / unlimiformer
  Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"
  ☆1,053Updated 8 months ago
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆459Updated last year
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,227Updated this week
• srush / raspy
  An interactive exploration of Transformer programming.
  ☆245Updated 11 months ago
• huggingface / datatrove
  Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
  ☆2,026Updated last week
• stanfordnlp / string2string
  String-to-String Algorithms for Natural Language Processing
  ☆534Updated 3 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆787Updated last week
• HazyResearch / H3
  Language Modeling with the H3 State Space Model
  ☆513Updated last year
• SkunkworksAI / hydra-moe
  ☆411Updated last year
• jxmorris12 / vec2text
  utilities for decoding deep representations (like sentence embeddings) back to text
  ☆732Updated last month
• JonasGeiping / cramming
  Cramming the training of a (BERT-type) language model into limited compute.
  ☆1,295Updated 4 months ago
• koaning / bulk
  A Simple Bulk Labelling Tool
  ☆550Updated 2 months ago
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆536Updated 5 months ago
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,121Updated 3 months ago
• rmihaylov / falcontune
  Tune any FALCON in 4-bit
  ☆468Updated last year
• philschmid / easyllm
  ☆433Updated 10 months ago