Alternatives and similar repositories for InsNet:

Users that are interested in InsNet are comparing it to the libraries listed below

• qsyao / cudaBERT
  A Fast Muti-processing BERT-Inference System
  ☆101Updated 2 years ago
• keithyin / read-pytorch-source-code
  pytorch源码阅读 0.2.0 版本
  ☆90Updated 5 years ago
• HadXu / Thunder
  A small deep-learning framework with C++/Python/CUDA
  ☆53Updated 7 years ago
• Oneflow-Inc / oneflow-documentation
  oneflow documentation
  ☆68Updated 10 months ago
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 3 years ago
• Oneflow-Inc / OneFlow-Benchmark
  OneFlow models for benchmarking.
  ☆104Updated 9 months ago
• LB-Yu / tinyflow
  A simple deep learning framework that supports automatic differentiation and GPU acceleration.
  ☆58Updated 2 years ago
• mrcat2018 / AutodiffEngine
  AutodiffEngine
  ☆13Updated 6 years ago
• starmee / AI-Notes
  My learning notes about AI, including Machine Learning and Deep Learning.
  ☆18Updated 5 years ago
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆132Updated last year
• tvmai / meetup-slides
  Place for meetup slides
  ☆140Updated 4 years ago
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆36Updated 2 months ago
• MARD1NO / CUDA-PPT
  ☆91Updated last month
• zakheav / automatic-differentiation-framework
  an automatic differentiation framework with dynamic graph/支持动态图的自动求导框架
  ☆101Updated 5 years ago
• NVIDIA / online-softmax
  Benchmark code for the "Online normalizer calculation for softmax" paper
  ☆91Updated 6 years ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆59Updated last year
• Tencent / WeChat-TFCC
  ☆127Updated 3 years ago
• BBuf / how-to-optimize-gemm
  ☆96Updated 3 years ago
• pigirons / conv3x3_m1
  This is a demo how to write a high performance convolution run on apple silicon
  ☆54Updated 3 years ago
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆130Updated last year
• pigirons / sgemm_hsw
  This is an implementation of sgemm_kernel on L1d cache.
  ☆228Updated last year
• msnh2012 / XNet
  Simple CuDNN wrapper
  ☆30Updated 9 years ago
• gfvvz / triton-learning-materials
  Triton Compiler related materials.
  ☆28Updated 4 months ago
• xieyu / read-tf
  notes on reading tensorflow source code
  ☆13Updated 6 years ago
• NVIDIA-Merlin / HierarchicalKV
  HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…
  ☆144Updated this week
• LeiWang1999 / tvm_gpu_gemm
  play gemm with tvm
  ☆91Updated last year
• XiuYuLi / flexible-gemm
  flexible-gemm conv of deepcore
  ☆17Updated 5 years ago
• OpenPPL / CuAssembler
  An unofficial cuda assembler, for all generations of SASS, hopefully ：）
  ☆83Updated 2 years ago
• dlsys-course / tinyflow
  Tutorial code on how to build your own Deep Learning System in 2k Lines
  ☆125Updated 8 years ago
• LeeJuly30 / BERTCpp
  implement bert in pure c++
  ☆36Updated 5 years ago