craffel / comp664-deep-learning-spring-2023Links
Course repository for the Spring 2023 COMP664 course "Deep Learning" at UNC
☆14Updated 2 years ago
Alternatives and similar repositories for comp664-deep-learning-spring-2023
Users that are interested in comp664-deep-learning-spring-2023 are comparing it to the libraries listed below
Sorting:
- ☆26Updated last year
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- ResiDual: Transformer with Dual Residual Connections, https://arxiv.org/abs/2304.14802☆95Updated 2 years ago
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"☆40Updated 10 months ago
- ☆23Updated 9 months ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated 2 years ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆24Updated last week
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts☆121Updated 11 months ago
- [COLM 2024] Early Weight Averaging meets High Learning Rates for LLM Pre-training☆17Updated 11 months ago
- ☆52Updated last year
- Visualising Losses in Deep Neural Networks☆16Updated last year
- The official repo of our research work "Interactive Editing for Text Summarization".☆22Updated 2 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated 2 years ago
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆40Updated last year
- A dashboard for exploring timm learning rate schedulers☆19Updated 10 months ago
- Embedding Recycling for Language models☆39Updated 2 years ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated 2 years ago
- Implementation of a Light Recurrent Unit in Pytorch☆48Updated 11 months ago
- ☆10Updated last year
- ML/DL Math and Method notes☆63Updated last year
- In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning☆35Updated 2 years ago
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆15Updated last year
- Explorations into adversarial losses on top of autoregressive loss for language modeling☆37Updated 7 months ago
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆29Updated this week
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Updated last year
- Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI☆56Updated 2 years ago
- Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch☆76Updated 2 years ago
- Utilities for Training Very Large Models☆58Updated last year
- Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…☆53Updated last year