nebuly-ai / exploring-AI-optimizationLinks
Curated list of awesome material on optimization techniques to make artificial intelligence faster and more efficient π
β118Updated last year
Alternatives and similar repositories for exploring-AI-optimization
Users that are interested in exploring-AI-optimization are comparing it to the libraries listed below
Sorting:
- ML/DL Math and Method notesβ63Updated last year
- ML model training for edge devicesβ166Updated last year
- experiments with inference on llamaβ104Updated last year
- Codes for paper "KNAS: Green Neural Architecture Search"β93Updated 3 years ago
- Functional local implementations of main model parallelism approachesβ96Updated 2 years ago
- A scalable & efficient active learning/data selection system for everyone.β215Updated last year
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Dayβ256Updated last year
- Context Manager to profile the forward and backward times of PyTorch's nn.Moduleβ83Updated last year
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and teβ¦β42Updated last year
- Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)β117Updated 3 years ago
- An open-source AutoML Library based on PyTorchβ306Updated last month
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog poβ¦β92Updated 2 years ago
- Official code for "SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient"β143Updated last year
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models accessβ¦β114Updated last year
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMsβ89Updated this week
- β29Updated 2 years ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".β277Updated last year
- Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.β37Updated 2 years ago
- Various transformers for FSDP researchβ38Updated 2 years ago
- Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)β105Updated 2 years ago
- ReLM is a Regular Expression engine for Language Modelsβ106Updated 2 years ago
- Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracyβ128Updated 2 years ago
- git extension for {collaborative, communal, continual} model developmentβ216Updated 9 months ago
- π€ Trade any tensors over the networkβ30Updated last year
- A miniture AI training framework for PyTorchβ42Updated 7 months ago
- β99Updated 2 months ago
- π Interactive performance profiling and debugging tool for PyTorch neural networks.β64Updated 7 months ago
- Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.β120Updated last year
- Large scale 4D parallelism pre-training for π€ transformers in Mixture of Experts *(still work in progress)*β87Updated last year
- β251Updated last year