octoml / Apple-M1-BERT

Related projects: ⓘ

• nod-ai / SRT
  Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …
  ☆107Updated this week
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated last year
• tlkh / m1-cpu-benchmarks
  ☆46Updated 2 years ago
• NVIDIA / LDDL
  Distributed preprocessing and data loading for language datasets
  ☆40Updated 5 months ago
• mlc-ai / llm-perf-bench
  ☆110Updated 4 months ago
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆173Updated 3 months ago
• marsupialtail / sparsednn
  Fast sparse deep learning on CPUs
  ☆51Updated last year
• pytorch / ort
  Accelerate PyTorch models with ONNX Runtime
  ☆353Updated 2 weeks ago
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆144Updated this week
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆358Updated 3 weeks ago
• kingoflolz / swarm-jax
  Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
  ☆236Updated last year
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆242Updated 2 years ago
• facebookresearch / FBTT-Embedding
  This is a Tensor Train based compression library to compress sparse embedding tables used in large-scale machine learning models such as …
  ☆192Updated 2 years ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆115Updated last month
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆273Updated last year
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆105Updated last year
• sdpython / mlprodict
  Productionize machine learning predictions, with ONNX or without
  ☆66Updated 8 months ago
• hidet-org / hidet
  An open-source efficient deep learning framework/compiler, written in python.
  ☆646Updated 3 weeks ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆145Updated this week
• triton-inference-server / fastertransformer_backend
  ☆411Updated 10 months ago
• microsoft / varuna
  ☆234Updated last month
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆53Updated 2 years ago
• smpanaro / more-ane-transformers
  Run transformers (incl. LLMs) on the Apple Neural Engine.
  ☆51Updated 9 months ago
• zphang / minimal-gpt-neox-20b
  ☆127Updated 2 years ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆125Updated 2 weeks ago
• graphcore / tutorials
  Training material for IPU users: tutorials, feature examples, simple applications
  ☆86Updated last year
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆117Updated last week
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA
  ☆48Updated this week
• huggingface / optimum-graphcore
  Blazing fast training of 🤗 Transformers on Graphcore IPUs
  ☆81Updated 6 months ago
• facebookresearch / diffq
  DiffQ performs differentiable quantization using pseudo quantization noise. It can automatically tune the number of bits used per weight …
  ☆229Updated last year