Alternatives and similar repositories for SimpleInfer:

Users that are interested in SimpleInfer are comparing it to the libraries listed below

• ChunelFeng / CGraph-lite
  A one-page-only CGraph-API-liked DAG project.
  ☆16Updated this week
• ozanarmagan / clip_tokenizer_cpp
  ☆10Updated 6 months ago
• Syencil / Programming_Massively_Parallel_Processors
  CUDA 6大并行计算模式 代码与笔记
  ☆60Updated 4 years ago
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆70Updated 2 months ago
• MARD1NO / Learning_CUDA
  ☆24Updated 3 years ago
• kalfazed / multi-thread-programming
  This is a repository to practice multi-thread programming in C++
  ☆19Updated 11 months ago
• piDack / The-ans-for-Programming-Massively-Parallel-Processor
  大规模并行处理器编程实战 第二版答案
  ☆30Updated 2 years ago
• Qingrenn / mmdeploy-summer-camp
  🐱 ncnn int8 模型量化评估
  ☆12Updated 2 years ago
• OpenPPL / ppl.kernel.cuda
  ☆35Updated 4 months ago
• MaybeShewill-CV / mortred_model_server
  High Performan Ai Model Web Server. Mainly support computer vision model. Quickly establish your own ai-model server. https://github.com/…
  ☆39Updated last month
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆44Updated 3 months ago
• OpenPPL / ppl.kernel.cpu
  ☆17Updated 10 months ago
• leimao / TensorRT-Custom-Plugin-Example
  Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration
  ☆51Updated 8 months ago
• HuPengsheet / EasyNN
  EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！
  ☆25Updated 5 months ago
• OpenPPL / ppl.common
  Common libraries for PPL projects
  ☆29Updated 3 months ago
• mrzhuzhe / riven
  CPU Memory Compiler and Parallel programing
  ☆25Updated 2 months ago
• zc911 / ParallelProgrammingInAction
  ☆14Updated 3 years ago
• JieRen98 / SGEMM-SASS-Annotation
  ☆19Updated 3 years ago
• yester31 / Cutlass_EX
  study of cutlass
  ☆21Updated 3 months ago
• BBuf / ArmNeonOptimization
  arm-neon
  ☆89Updated 6 months ago
• sunkx109 / llama.cpp
  llama 2 Inference
  ☆41Updated last year
• zpethan / master-cudnn
  解读cudnn文档，掌握其用法
  ☆16Updated 9 months ago
• zjhellofss / KuiperCourse
  b站上的课程
  ☆71Updated last year
• BBuf / how-to-optimize-gemm
  ☆95Updated 3 years ago
• Zheng-Bicheng / BreezeDeploy
  ☆11Updated 9 months ago
• zeroine / cutlass-cute-sample
  ☆26Updated 10 months ago
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆83Updated this week
• GetUpEarlier / minit
  ☆26Updated 8 months ago
• hova88 / CUDA-MatMul-Practice
  ☆15Updated last year
• jundaf2 / CUDA-INT8-GEMM
  CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA API
  ☆28Updated last year