tjyuyao / cutexView external linksLinks
PyCUDA based PyTorch Extension Made Easy
☆26Mar 22, 2024Updated last year
Alternatives and similar repositories for cutex
Users that are interested in cutex are comparing it to the libraries listed below
Sorting:
- Unofficial implementation of paper : Exploring the Space of Key-Value-Query Models with Intention☆12May 24, 2023Updated 2 years ago
- Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"☆18Mar 15, 2024Updated last year
- Combining SOAP and MUON☆19Feb 11, 2025Updated last year
- 🧮 Algebraic Positional Encodings.☆18Aug 20, 2025Updated 5 months ago
- [ICML 2023] "Data Efficient Neural Scaling Law via Model Reusing" by Peihao Wang, Rameswar Panda, Zhangyang Wang☆14Jan 4, 2024Updated 2 years ago
- Expanding linear RNN state-transition matrix eigenvalues to include negatives improves state-tracking tasks and language modeling without…☆19Mar 15, 2025Updated 10 months ago
- Mamba support for transformer lens☆19Sep 17, 2024Updated last year
- ☆24Sep 25, 2024Updated last year
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆24Jun 6, 2024Updated last year
- Checkpointable dataset utilities for foundation model training☆32Jan 29, 2024Updated 2 years ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆27Apr 17, 2024Updated last year
- ☆50Jun 16, 2025Updated 7 months ago
- Official Repo for Error-Free Linear Attention is a Free Lunch: Exact Solution from Continuous-Time Dynamics☆71Jan 13, 2026Updated last month
- ☆33Oct 4, 2024Updated last year
- ☆35Apr 8, 2025Updated 10 months ago
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training (ICLR 2023)☆32Apr 8, 2023Updated 2 years ago
- Template Code for TOC Project 2017☆10Apr 26, 2017Updated 8 years ago
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆129Jun 24, 2025Updated 7 months ago
- ☆12Jan 21, 2025Updated last year
- Official code for the paper "Attention as a Hypernetwork"☆47Jun 22, 2024Updated last year
- Publish Paper in Markdown Format☆10Jun 5, 2019Updated 6 years ago
- C4RepSet: Representative Subset from C4 data for Training Pre-trained LMs☆11Jan 13, 2023Updated 3 years ago
- ☆12Jul 7, 2022Updated 3 years ago
- Text preprocessing package for use in NLP tasks https://pypi.org/project/textcl/☆11Aug 9, 2024Updated last year
- [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.☆34May 6, 2024Updated last year
- Statistical discontinuous constituent parsing☆11Feb 15, 2018Updated 7 years ago
- ☆66Jul 8, 2025Updated 7 months ago
- PyTorch optimizers with sparse momentum and weight decay☆10Oct 3, 2020Updated 5 years ago
- Repository for SPECTRA: Sparse Structured Text Rationalization, accepted at EMNLP 2021 main conference.☆10Feb 14, 2024Updated 2 years ago
- ☆12Mar 30, 2025Updated 10 months ago
- A PyTorch Lightning template to try out a wide range of ideas on the Ubiquant Market Prediction competition without modifying any code!☆12Mar 24, 2022Updated 3 years ago
- Official codebase for our paper "Do Language Models Use Their Depth Efficiently?"☆29Jun 25, 2025Updated 7 months ago
- Non Metric Space ( Approximate ) Library in R☆12Feb 2, 2023Updated 3 years ago
- A pretty-printer for X12 EDI files☆11Jun 21, 2021Updated 4 years ago
- Universal, language-agnostic development standards for software projects. Includes coding standards, git workflows, testing guidelines, d…☆36Updated this week
- Improving transparency of large language models' reasoning☆14Nov 25, 2025Updated 2 months ago
- Code for "Inducer-tuning: Connecting Prefix-tuning and Adapter-tuning" (EMNLP 2022) and "Empowering Parameter-Efficient Transfer Learning…☆11Feb 6, 2023Updated 3 years ago
- Advanced Formal Language Theory (263-5352-00L; Frühjahr 2023)☆10Feb 21, 2023Updated 2 years ago