junfanz1 / MiniGPT-and-DeepSeek-MLA-Multi-Head-Latent-AttentionView external linksLinks
An efficient and scalable attention module designed to reduce memory usage and improve inference speed in large language models. Designed and implemented the Multi-Head Latent Attention (MLA) module as a drop-in replacement for traditional multi-head attention (MHA) in large language models.
☆21Jun 25, 2025Updated 7 months ago
Alternatives and similar repositories for MiniGPT-and-DeepSeek-MLA-Multi-Head-Latent-Attention
Users that are interested in MiniGPT-and-DeepSeek-MLA-Multi-Head-Latent-Attention are comparing it to the libraries listed below
Sorting:
- Modding the LOOΠΔ light stick with a custom PCB/firmware, rechargeable battery and a companion Android app for wireless control.☆13Sep 16, 2022Updated 3 years ago
- Handwritten digit classification web app using Streamlit☆10Jan 15, 2024Updated 2 years ago
- ☆11Jun 7, 2024Updated last year
- Like cookiecutter_pypackage, but for just a module.☆14Jul 27, 2016Updated 9 years ago
- Access to Piwik API in Python + django app.☆19Apr 15, 2012Updated 13 years ago
- Model-based time series clustering using variational inference.☆12Oct 28, 2018Updated 7 years ago
- Examples from the Openlane repository, adapted as Fusesoc cores☆12May 18, 2021Updated 4 years ago
- A Cookie Cutter template for a Pyramid package☆10Jun 2, 2016Updated 9 years ago
- Training a BERT model from scratch.☆11Oct 15, 2023Updated 2 years ago
- ☆11Updated this week
- ☆16Jul 7, 2025Updated 7 months ago
- Long Context Research☆26Jan 26, 2026Updated 3 weeks ago
- Bundle up Python deployment packages for AWS Lambda☆14Apr 20, 2021Updated 4 years ago
- SystemVerilog implemention of QEMU PCI edu device☆13May 22, 2023Updated 2 years ago
- WaterPy - Water and Environment Tools in Python☆15Mar 12, 2017Updated 8 years ago
- A Bigram Language Model from scratch with no-smoothing and add-one smoothing. Outputs bigram counts, bigram probabilities and probability…☆15Jan 12, 2021Updated 5 years ago
- A JavaScript implementation of Richard Dawkin's Biomorph, a simulation that demonstrates the power of natural selection.☆13Dec 11, 2012Updated 13 years ago
- [NeurIPS 2025] HoPE: Hybrid of Position Embedding for Long Context Vision-Language Models☆26Nov 30, 2025Updated 2 months ago
- Penrose tile composition using only two shapes and a few substitution rules☆13Feb 12, 2020Updated 6 years ago
- Javascript wrapper bindings for diamond types☆13Sep 13, 2021Updated 4 years ago
- Graphics engine for games, set on top of bun.js.☆20Apr 2, 2025Updated 10 months ago
- Keyboard Shortcuts for your Django Admin Backend.☆13Sep 14, 2015Updated 10 years ago
- [ICLR 2025] Official PyTorch implementation of our paper for general continual learning "Advancing Prompt-Based Methods for Replay-Indepe…☆16Dec 21, 2025Updated last month
- Example implementation of "Exact Byte-Level Probabilities from Tokenized Language Models for FIM-Tasks and Model Ensembles" by Buu Phan, …☆18Jan 22, 2026Updated 3 weeks ago
- Mount python — it's fun, not a typo, and next to pointless!☆50Jun 30, 2014Updated 11 years ago
- ☆14Aug 31, 2022Updated 3 years ago
- 一个部署在windows本地主机上的根因分析系统，作为数据库，网页开发练手的小demo☆14Jun 24, 2020Updated 5 years ago
- When you really need a Tomek decorator☆12May 4, 2022Updated 3 years ago
- Fabric Scripts for setup of CodeBetter.Com's Linux Host☆24Feb 23, 2011Updated 14 years ago
- ☆16Feb 9, 2026Updated last week
- ☆23Oct 21, 2025Updated 3 months ago
- Kylie maps between Model objects and JSON data structures.☆12Dec 26, 2022Updated 3 years ago
- Shows a simplified view of the call stack.☆11Aug 25, 2022Updated 3 years ago
- A 4-hour long tutorial session for learning to use LLMs and align them with custom data. We will also train a custom LLM.☆17Sep 12, 2024Updated last year
- iPython notebooks and data files for the 'Pandas in a Hurry' tutorial of the 2015 San Diego Data Science Fun Conference☆12Feb 27, 2015Updated 10 years ago
- as miñas modificacións sobre o linklayertools☆16Sep 9, 2013Updated 12 years ago
- A preservation experiment to save photos from Flickr to your disk with the metadata embedded.☆17Mar 23, 2025Updated 10 months ago
- ☆15Updated this week
- GIS scripts and tools☆17Jul 13, 2024Updated last year