Alternatives and similar repositories for SDLG

Users that are interested in SDLG are comparing it to the libraries listed below

• vertaix / Vendi-Score
  ☆131Updated 2 weeks ago
• Modalities / modalities
  Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.
  ☆85Updated this week
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆63Updated last year
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆32Updated 4 months ago
• JHU-CLSP / ettin-encoder-vs-decoder
  State-of-the-art paired encoder and decoder models (17M-1B params)
  ☆38Updated last week
• ltgoslo / gpt-bert
  Official implementation of "GPT or BERT: why not both?"
  ☆57Updated last week
• ltgoslo / ltg-bert
  LTG-Bert
  ☆33Updated last year
• epfml / DenseFormer
  ☆81Updated last year
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆53Updated last year
• KaiNylund / lm-weights-encode-time
  ☆69Updated 11 months ago
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆58Updated last year
• VectorInstitute / vector-inference
  Efficient LLM inference on Slurm clusters using vLLM.
  ☆69Updated this week
• jxiw / BiGS
  Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …
  ☆114Updated last year
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆41Updated 9 months ago
• AndyShih12 / LongHorizonTemperatureScaling
  PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023
  ☆20Updated 2 years ago
• shreyansh26 / LLM-Sampling
  A collection of various LLM sampling methods implemented in pure Pytorch
  ☆23Updated 8 months ago
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆102Updated 2 months ago
• guy-dar / embedding-space
  ☆54Updated 2 years ago
• naver / disco
  A Toolkit for Distributional Control of Generative Models
  ☆73Updated last week
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆88Updated 5 months ago
• bjoernpl / GermanBenchmark
  A repository containing the code for translating popular LLM benchmarks to German.
  ☆27Updated last year
• zouharvi / tokenization-scorer
  Simple-to-use scoring function for arbitrarily tokenized texts.
  ☆45Updated 5 months ago
• mcleish7 / gemstone-scaling-laws
  ☆28Updated 5 months ago
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆107Updated 4 months ago
• bartbussmann / BatchTopK
  Implementation of the BatchTopK activation function for training sparse autoencoders (SAEs)
  ☆44Updated 2 weeks ago
• msakarvadia / AttentionLens
  Interpretating the latent space representations of attention head outputs for LLMs
  ☆34Updated 11 months ago
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆39Updated 2 years ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆59Updated last year
• TristanThrush / perplexity-correlations
  Simple and scalable tools for data-driven pretraining data selection.
  ☆25Updated 2 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆97Updated last year