craffel / comp664-deep-learning-spring-2023Links
Course repository for the Spring 2023 COMP664 course "Deep Learning" at UNC
☆15Updated 2 years ago
Alternatives and similar repositories for comp664-deep-learning-spring-2023
Users that are interested in comp664-deep-learning-spring-2023 are comparing it to the libraries listed below
Sorting:
- My explorations into editing the knowledge and memories of an attention network☆35Updated 3 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆35Updated 2 years ago
- Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012☆49Updated 3 years ago
- ☆53Updated last year
- ResiDual: Transformer with Dual Residual Connections, https://arxiv.org/abs/2304.14802☆96Updated 2 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- ☆26Updated 2 years ago
- 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.☆81Updated 3 years ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated 2 years ago
- Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch☆76Updated 3 years ago
- ML/DL Math and Method notes☆65Updated 2 years ago
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts☆121Updated last year
- Implementation of Insertion-deletion Denoising Diffusion Probabilistic Models☆30Updated 3 years ago
- RWKV model implementation☆38Updated 2 years ago
- Embedding Recycling for Language models☆38Updated 2 years ago
- [COLM 2024] Early Weight Averaging meets High Learning Rates for LLM Pre-training☆18Updated last year
- A dashboard for exploring timm learning rate schedulers☆19Updated last year
- Visualising Losses in Deep Neural Networks☆16Updated last year
- ☆24Updated last year
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆40Updated 2 years ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆50Updated 3 years ago
- Utilities for PyTorch distributed☆25Updated 9 months ago
- Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI☆56Updated 2 years ago
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆28Updated last year
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆49Updated 4 years ago
- Minimum Description Length probing for neural network representations☆20Updated 10 months ago
- Transformers at any scale☆42Updated last year
- ☆29Updated 3 years ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated 2 years ago