Alternatives and similar repositories for comp664-deep-learning-spring-2023

Users that are interested in comp664-deep-learning-spring-2023 are comparing it to the libraries listed below

• sanyalsunny111 / Early_Weight_Avg
  [COLM 2024] Early Weight Averaging meets High Learning Rates for LLM Pre-training
  ☆17Updated 10 months ago
• srush / LLM-Talk
  ☆51Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• microsoft / ResiDual
  ResiDual: Transformer with Dual Residual Connections, https://arxiv.org/abs/2304.14802
  ☆95Updated 2 years ago
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆120Updated 10 months ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated 2 years ago
• hamishivi / tess-2
  Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"
  ☆51Updated 6 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year
• kyegomez / Reka-Torch
  Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch
  ☆29Updated 3 weeks ago
• lucidrains / transformer-lm-gan
  Explorations into adversarial losses on top of autoregressive loss for language modeling
  ☆37Updated 6 months ago
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆40Updated 9 months ago
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆48Updated 10 months ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 11 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated 7 months ago
• nreHieW / loss
  Visualising Losses in Deep Neural Networks
  ☆16Updated last year
• EleutherAI / training-jacobian
  ☆23Updated 8 months ago
• xhan77 / in-context-alignment
  In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning
  ☆35Updated 2 years ago
• Doraemonzzz / Awesome-Triton-Resources
  Awesome Triton Resources
  ☆33Updated 4 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated 2 years ago
• huggingface / peft-pytorch-conference
  Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…
  ☆14Updated last year
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated 2 years ago
• lucidrains / self-reasoning-tokens-pytorch
  Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
  ☆56Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆38Updated 2 months ago
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆44Updated 9 months ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆27Updated last year
• haileyschoelkopf / triton-index
  See https://github.com/cuda-mode/triton-index/ instead!
  ☆11Updated last year
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆30Updated 10 months ago
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆48Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆63Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆39Updated 2 years ago