explosion / curated-transformers

Related projects ⓘ

Alternatives and complementary repositories for curated-transformers

• PiotrNawrot / nanoT5
  Fast & Simple repository for pre-training and fine-tuning T5-style models
  ☆970Updated 3 months ago
• HazyResearch / meerkat
  Creative interactive views of any dataset.
  ☆829Updated 8 months ago
• raphaelsty / neural-cherche
  Neural Search
  ☆344Updated 5 months ago
• pbelcak / UltraFastBERT
  The repository for the code of the UltraFastBERT paper
  ☆514Updated 7 months ago
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆903Updated 10 months ago
• alasdairforsythe / tokenmonster
  Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript
  ☆551Updated 4 months ago
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆702Updated last year
• allenai / tango
  Organize your experiments into discrete steps that can be cached and reused throughout the lifetime of your research project.
  ☆534Updated 5 months ago
• qdrant / quaterion
  Blazing fast framework for fine-tuning similarity learning models
  ☆643Updated last month
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆270Updated 3 weeks ago
• persimmon-ai-labs / adept-inference
  Inference code for Persimmon-8B
  ☆416Updated last year
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆325Updated last year
• srush / raspy
  An interactive exploration of Transformer programming.
  ☆246Updated last year
• JonasGeiping / cramming
  Cramming the training of a (BERT-type) language model into limited compute.
  ☆1,296Updated 5 months ago
• tysam-code / hlb-gpt
  Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…
  ☆334Updated 3 months ago
• HazyResearch / safari
  Convolutions for Sequence Modeling
  ☆869Updated 5 months ago
• r2d4 / rellm
  Exact structure out of any language model completion.
  ☆502Updated last year
• abertsch72 / unlimiformer
  Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"
  ☆1,055Updated 8 months ago
• sanjeevanahilan / nanoChatGPT
  A crude RLHF layer on top of nanoGPT with Gumbel-Softmax trick
  ☆287Updated 11 months ago
• stanfordnlp / string2string
  String-to-String Algorithms for Natural Language Processing
  ☆536Updated 3 months ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆675Updated 7 months ago
• stanford-crfm / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆516Updated this week
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆460Updated last year
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆537Updated 6 months ago
• koaning / embetter
  just a bunch of useful embeddings
  ☆466Updated 2 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆811Updated this week
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆257Updated 4 months ago
• BobaZooba / xllm
  🦖 X—LLM: Cutting Edge & Easy LLM Finetuning
  ☆381Updated 10 months ago