determined-ai / determined-examplesLinks
Example ML projects that use the Determined library.
☆32Updated 11 months ago
Alternatives and similar repositories for determined-examples
Users that are interested in determined-examples are comparing it to the libraries listed below
Sorting:
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆61Updated 10 months ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated last year
- A parallel framework for training deep neural networks☆63Updated 5 months ago
- NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference☆68Updated 8 months ago
- A collection of reproducible inference engine benchmarks☆32Updated 4 months ago
- ☆49Updated 9 months ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆208Updated last week
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆73Updated last year
- ☆95Updated 10 months ago
- ☆74Updated 5 months ago
- ☆121Updated last year
- Easy and Efficient Quantization for Transformers☆203Updated 2 months ago
- Make triton easier☆47Updated last year
- Simple implementation of Speculative Sampling in NumPy for GPT-2.☆95Updated 2 years ago
- The Triton backend for the PyTorch TorchScript models.☆158Updated 3 weeks ago
- Benchmark suite for LLMs from Fireworks.ai☆80Updated this week
- LM engine is a library for pretraining/finetuning LLMs☆65Updated this week
- Boosting 4-bit inference kernels with 2:4 Sparsity☆80Updated 11 months ago
- ☆15Updated last week
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆201Updated last week
- ☆20Updated 4 months ago
- ☆48Updated last year
- A bunch of kernels that might make stuff slower 😉☆58Updated last week
- The evaluation framework for training-free sparse attention in LLMs☆91Updated 2 months ago
- Code for studying the super weight in LLM☆115Updated 8 months ago
- Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…☆153Updated 4 months ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆60Updated this week
- Distributed preprocessing and data loading for language datasets☆39Updated last year
- FlexAttention w/ FlashAttention3 Support☆27Updated 10 months ago
- Torch Distributed Experimental☆117Updated last year