facebookresearch / RLCompOpt
Learning Compiler Pass Orders using Coreset and Normalized Value Prediction. (ICML 2023)
☆18Updated last year
Related projects ⓘ
Alternatives and complementary repositories for RLCompOpt
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆20Updated last week
- Experimental scripts for researching data adaptive learning rate scheduling.☆23Updated last year
- ☆32Updated last week
- ☆44Updated 11 months ago
- Prototype routines for GPU quantization written using PyTorch.☆19Updated last week
- Repository for CPU Kernel Generation for LLM Inference☆25Updated last year
- MACTA: A Multi-agent Reinforcement Learning Approach for Cache Timing Attacks and Detection☆45Updated last year
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆37Updated last year
- ☆39Updated 10 months ago
- FlexAttention w/ FlashAttention3 Support☆27Updated last month
- NASRec Weight Sharing Neural Architecture Search for Recommender Systems☆27Updated 11 months ago
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆43Updated last year
- ☆47Updated 2 months ago
- OpenSFEDS, a near-eye gaze estimation dataset containing approximately 2M synthetic camera-photosensor image pairs sampled at 500 Hz unde…☆13Updated 7 months ago
- Memory Optimizations for Deep Learning (ICML 2023)☆60Updated 8 months ago
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated last year
- Patch convolution to avoid large GPU memory usage of Conv2D☆79Updated 5 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆35Updated 4 months ago
- Code for studying the super weight in LLM☆16Updated last week
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆14Updated 8 months ago
- Unit Scaling demo and experimentation code☆16Updated 8 months ago
- IntLLaMA: A fast and light quantization solution for LLaMA☆18Updated last year
- ☆29Updated 5 months ago
- JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)☆29Updated 6 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"☆56Updated last month
- Triton Implementation of HyperAttention Algorithm☆46Updated 11 months ago
- Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs☆74Updated 5 months ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆38Updated 10 months ago