Alternatives and similar repositories for dlsys-solution

Users that are interested in dlsys-solution are comparing it to the libraries listed below

• qsyao / cudaBERT
  A Fast Muti-processing BERT-Inference System
  ☆101Updated 2 years ago
• LeeJuly30 / BERTCpp
  implement bert in pure c++
  ☆36Updated 5 years ago
• chncwang / InsNet
  InsNet Runs Instance-dependent Neural Networks with Padding-free Dynamic Batching.
  ☆67Updated 3 years ago
• lonePatient / MobileBert_PyTorch
  MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
  ☆69Updated 5 years ago
• Oneflow-Inc / OneFlow-Benchmark
  OneFlow models for benchmarking.
  ☆104Updated last year
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆146Updated 3 years ago
• keithyin / read-pytorch-source-code
  pytorch源码阅读 0.2.0 版本
  ☆91Updated 5 years ago
• LieluoboAi / radish
  C++ model train&inference framework
  ☆223Updated 5 years ago
• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆99Updated 11 months ago
• HadXu / Thunder
  A small deep-learning framework with C++/Python/CUDA
  ☆54Updated 7 years ago
• thuwyh / InferLight
  lightweighted deep learning inference service framework
  ☆40Updated 4 years ago
• OpenBMB / cpm_kernels
  ☆25Updated 2 years ago
• zhihu / cuBERT
  Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL
  ☆546Updated 4 years ago
• PaddlePaddle / benchmark
  ☆80Updated last month
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆50Updated last year
• JohnRabbbit / TF2Fluid
  Deep learning by using PaddleFluid and TensorFlow.
  ☆31Updated 7 years ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated 2 years ago
• Andrew-Tierno / QuantizedTransformer
  Implementation of a Quantized Transformer Model
  ☆19Updated 6 years ago
• borgwang / tinynn-autograd
  tinynn with automatic differentiation
  ☆40Updated 2 years ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆59Updated 2 years ago
• CLUEbenchmark / MobileQA
  离线端阅读理解应用 QA for mobile, Android & iPhone
  ☆60Updated 2 years ago
• miemie2013 / Pure_Python_Deep_Learning
  纯Python实现的深度学习框架，帮助你理解底层细节斩获offer
  ☆21Updated 3 years ago
• PaddlePaddle / PALM
  a Fast, Flexible, Extensible and Easy-to-use NLP Large-scale Pretraining and Multi-task Learning Framework.
  ☆184Updated 4 years ago
• ericperfect / libtorch_tokenizer
  BERT Tokenizer in C++
  ☆78Updated 4 years ago
• bojone / keras_recompute
  saving memory by recomputing for keras
  ☆37Updated 5 years ago
• sebgao / cTensor
  A super light-weight deep learning library based on NumPy in PyTorch fashion.
  ☆94Updated 4 years ago
• dhpollack / huggingface_libtorch
  Minimal example of using a traced huggingface transformers model with libtorch
  ☆36Updated 5 years ago
• wangguojim / LargeScale
  ☆19Updated last year
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆290Updated 3 years ago
• BeyonderXX / tensorflow-serving-tutorial
  A tutorial of building tensorflow serving service from scratch
  ☆89Updated 2 years ago