facebookresearch / RLCompOpt
Learning Compiler Pass Orders using Coreset and Normalized Value Prediction. (ICML 2023)
☆18Updated last year
Alternatives and similar repositories for RLCompOpt:
Users that are interested in RLCompOpt are comparing it to the libraries listed below
- Experimental scripts for researching data adaptive learning rate scheduling.☆23Updated last year
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆21Updated 3 weeks ago
- A list of awesome neural symbolic papers.☆44Updated 2 years ago
- FlexAttention w/ FlashAttention3 Support☆27Updated 3 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆43Updated 6 months ago
- MACTA: A Multi-agent Reinforcement Learning Approach for Cache Timing Attacks and Detection☆46Updated last year
- Lightning support for Intel Habana accelerators.☆25Updated 2 weeks ago
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆44Updated last year
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"☆58Updated 3 months ago
- NASRec Weight Sharing Neural Architecture Search for Recommender Systems☆29Updated last year
- ☆52Updated last week
- Repository for CPU Kernel Generation for LLM Inference☆25Updated last year
- Hacks for PyTorch☆18Updated last year
- Unit Scaling demo and experimentation code☆16Updated 10 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆75Updated this week
- Prototype routines for GPU quantization written using PyTorch.☆19Updated last month
- IntLLaMA: A fast and light quantization solution for LLaMA☆18Updated last year
- Experiment of using Tangent to autodiff triton☆74Updated 11 months ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆40Updated last year
- code for paper "Accessing higher dimensions for unsupervised word translation"☆21Updated last year
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models☆28Updated 7 months ago
- [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts☆38Updated 10 months ago
- ☆11Updated 5 months ago
- Memory Optimizations for Deep Learning (ICML 2023)☆62Updated 10 months ago
- Utilities for Training Very Large Models☆57Updated 3 months ago
- ☆45Updated last year
- Here we will test various linear attention designs.☆58Updated 8 months ago
- Causal Analysis of Agent Behavior for AI Safety☆17Updated last year
- DPO, but faster 🚀☆29Updated last month