Alternatives and similar repositories for InsNet

Users that are interested in InsNet are comparing it to the libraries listed below

• qsyao / cudaBERT
  A Fast Muti-processing BERT-Inference System
  ☆101Updated 2 years ago
• Oneflow-Inc / OneFlow-Benchmark
  OneFlow models for benchmarking.
  ☆104Updated last year
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆146Updated 3 years ago
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆290Updated 3 years ago
• keithyin / read-pytorch-source-code
  pytorch源码阅读 0.2.0 版本
  ☆91Updated 5 years ago
• tvmai / meetup-slides
  Place for meetup slides
  ☆140Updated 4 years ago
• Oneflow-Inc / oneflow-documentation
  oneflow documentation
  ☆69Updated last year
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆132Updated 2 years ago
• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆100Updated 11 months ago
• HadXu / Thunder
  A small deep-learning framework with C++/Python/CUDA
  ☆54Updated 7 years ago
• starmee / AI-Notes
  My learning notes about AI, including Machine Learning and Deep Learning.
  ☆18Updated 6 years ago
• msnh2012 / XNet
  Simple CuDNN wrapper
  ☆30Updated 9 years ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆475Updated 3 years ago
• LiebingYu / tinyflow
  A simple deep learning framework that supports automatic differentiation and GPU acceleration.
  ☆59Updated 2 years ago
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆132Updated 2 years ago
• dlsys-course / tinyflow
  Tutorial code on how to build your own Deep Learning System in 2k Lines
  ☆124Updated 8 years ago
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆40Updated 7 months ago
• pigirons / sgemm_hsw
  This is an implementation of sgemm_kernel on L1d cache.
  ☆229Updated last year
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆59Updated 2 years ago
• BBuf / how-to-optimize-gemm
  ☆98Updated 4 years ago
• PaddlePaddle / CINN
  Compiler Infrastructure for Neural Networks
  ☆147Updated 2 years ago
• Tencent / WeChat-TFCC
  ☆127Updated 4 years ago
• mrcat2018 / AutodiffEngine
  AutodiffEngine
  ☆13Updated 6 years ago
• Oneflow-Inc / oneflow-xrt
  ☆23Updated 2 years ago
• volcengine / veGiantModel
  ☆220Updated 2 years ago
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆478Updated last year
• whitelok / tvm-lesson
  动手学习TVM核心原理教程
  ☆63Updated 4 years ago
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 3 years ago
• tengkz / tensorflow_notes
  tensorflow源码阅读笔记
  ☆192Updated 7 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago