working implimention of deepseek MLA
☆45Jan 8, 2025Updated last year
Alternatives and similar repositories for Multi-Head-Latent-Attention-MLA-
Users that are interested in Multi-Head-Latent-Attention-MLA- are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- fuchsia: minimal libaray for RL on LLMs☆10Mar 8, 2026Updated 8 months ago
- ☆20Aug 19, 2024Updated 2 years ago
- Hypernetworks for kohya's sd-scripts☆18May 29, 2023Updated 3 years ago
- BigKnow2022: Bringing Language Models Up to Speed☆16Mar 27, 2023Updated 3 years ago
- ☆20Jul 31, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A simple python package for Neural Network based on numpy☆13Sep 6, 2021Updated 5 years ago
- ☆17May 6, 2025Updated last year
- ☆36Sep 22, 2025Updated last year
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆145May 8, 2025Updated last year
- Understand Human Behavior to Align True Needs☆25Jul 11, 2024Updated 2 years ago
- LoRA for convolution layer☆22Mar 9, 2023Updated 3 years ago
- upload a manim script and generate an animation☆11Mar 10, 2024Updated 2 years ago
- An AI-powered git commit message generator written in python.☆22Feb 16, 2023Updated 3 years ago
- A PyTorch implementation of perceptual loss using ConvNeXt feature extractors.☆30Nov 14, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Repo du cours d'introduction à l'apprentissage par renforcement.☆19Feb 2, 2025Updated last year
- H-Net Dynamic Hierarchical Architecture☆81Sep 11, 2025Updated last year
- Collection of autoregressive model implementation☆85Oct 1, 2026Updated last month
- ☆33Sep 10, 2024Updated 2 years ago
- ☆12Feb 6, 2025Updated last year
- Supporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"☆11Mar 31, 2024Updated 2 years ago
- Verilog implementation of Mersenne Twister PRNG☆32Jun 20, 2018Updated 8 years ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆17Jun 16, 2024Updated 2 years ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆94Oct 30, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- manipulating cointegrated pairs to achieve a market-neutral strategy that outperforms indices☆11Jan 12, 2021Updated 5 years ago
- DeMo: Decoupled Momentum Optimization☆202Dec 2, 2024Updated last year
- ☆45Mar 31, 2025Updated last year
- Entropy Based Sampling and Parallel CoT Decoding☆17Oct 9, 2024Updated 2 years ago
- Minimal GPT training and inference in C and CUDA that's just as fast as PyTorch☆10Apr 18, 2025Updated last year
- Approximating the joint distribution of language models via MCTS☆22Nov 3, 2024Updated 2 years ago
- TEVO: evolve LM motifs cheaply, then validate them in downstream train.py loops.☆20Apr 18, 2026Updated 7 months ago
- A demo for the Direct Ascent Synthesis: Hidden Generative Capabilities in Discriminative Models paper (https://arxiv.org/abs/2502.07753)☆43Mar 5, 2025Updated last year
- Simple GRPO scripts and configurations.☆59Feb 6, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆12Apr 1, 2025Updated last year
- ☆36Mar 12, 2025Updated last year
- Hierarchical multi-agent architecture for AI agent organizations☆18Apr 9, 2026Updated 7 months ago
- Complexity vs. Accuracy: On Mechanistic Interpretability's Dependence on the Linear Representation Hypothesis☆14Oct 9, 2025Updated last year
- Quasar Attention Continuous-Time Memory Dynamics for Scaling Models Context to Millions of Tokens☆30Mar 26, 2026Updated 7 months ago
- Point2color: 3D Point Cloud Colorization Using a Conditional Generative Network and Differentiable Rendering for Airborne LiDAR[Earth Vis…☆11Oct 31, 2021Updated 5 years ago
- CLI tool for submitting GPU kernels☆12Apr 28, 2026Updated 6 months ago
Are these results useful?