octoml / Apple-M1-BERT
3X speedup over Apple’s TensorFlow plugin by using Apache TVM on M1
☆136Updated 3 years ago
Alternatives and similar repositories for Apple-M1-BERT:
Users that are interested in Apple-M1-BERT are comparing it to the libraries listed below
- benchmarking some transformer deployments☆26Updated 2 years ago
- Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …☆106Updated 3 months ago
- Training material for IPU users: tutorials, feature examples, simple applications☆86Updated 2 years ago
- Fast sparse deep learning on CPUs☆53Updated 2 years ago
- Home for OctoML PyTorch Profiler☆112Updated last year
- Torch Distributed Experimental☆115Updated 8 months ago
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆180Updated 4 months ago
- Blazing fast training of 🤗 Transformers on Graphcore IPUs☆85Updated last year
- Python bindings for ggml☆140Updated 7 months ago
- 🍏 Make Thinc faster on macOS by calling into Apple's native Accelerate library☆94Updated 6 months ago
- Example code and applications for machine learning on Graphcore IPUs☆320Updated last year
- Implementation of a Transformer, but completely in Triton☆263Updated 3 years ago
- Training neural networks in TensorFlow 2.0 with 5x less memory☆130Updated 3 years ago
- ☆118Updated last year
- Productionize machine learning predictions, with ONNX or without☆65Updated last year
- Inference code for LLaMA models in JAX☆117Updated 11 months ago
- A library for syntactically rewriting Python programs, pronounced (sinner).☆69Updated 3 years ago
- ☆87Updated 2 years ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆156Updated 4 months ago
- Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)☆116Updated 3 years ago
- ☆67Updated 2 years ago
- This repository contains the results and code for the MLPerf™ Training v0.7 benchmark.☆56Updated last year
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆238Updated last year
- Tutorial on how to convert machine learned models into ONNX☆16Updated 2 years ago
- GPTQ inference Triton kernel☆299Updated last year
- experiments with inference on llama☆104Updated 10 months ago
- This repository contains example code to build models on TPUs☆30Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆262Updated 6 months ago
- ☆69Updated 2 years ago
- ☆56Updated 2 years ago