DeepLink-org / AIChipBenchmark

Related projects: ⓘ

• OpenPPL / ppl.llm.serving
  ☆123Updated 3 months ago
• OpenPPL / ppl.llm.kernel.cuda
  ☆133Updated 2 months ago
• openppl-public / ppl.nn.llm
  ☆140Updated 4 months ago
• OpenPPL / ppl.pmx
  ☆56Updated last week
• FlagOpen / FlagGems
  FlagGems is an operator library for large language models implemented in Triton Language.
  ☆246Updated last week
• Deep-Spark / DeepSpark
  The DeepSpark open platform selects hundreds of open source application algorithms and models that are deeply coupled with industrial app…
  ☆26Updated this week
• AyakaGEMM / Hands-on-GEMM
  ☆90Updated 6 months ago
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆188Updated 3 weeks ago
• Deep-Spark / DeepSparkHub
  DeepSparkHub selects hundreds of application algorithms and models, covering various fields of AI and general-purpose computing, to suppo…
  ☆46Updated last week
• ModelTC / llmc
  This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit…
  ☆227Updated this week
• Ascend / pytorch
  Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch
  ☆226Updated last week
• OpenPPL / ppl.kernel.cuda
  ☆32Updated 3 months ago
• ModelTC / NART
  NART = NART is not A RunTime, a deep learning inference framework.
  ☆38Updated last year
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆20Updated 2 weeks ago
• Cambricon / mlu-ops
  Efficient operation implementation based on the Cambricon Machine Learning Unit (MLU) .
  ☆100Updated last week
• DeepLink-org / DIOPI
  ☆68Updated 2 weeks ago
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 2 years ago
• pcg-mlp / KsanaLLM
  ☆251Updated last week
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆129Updated last week
• PaddlePaddle / PaddleCustomDevice
  PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)
  ☆67Updated last week
• Oneflow-Inc / oneflow-xrt
  ☆22Updated last year
• LLMServe / DistServe
  Disaggregated serving system for Large Language Models (LLMs).
  ☆278Updated last month
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆71Updated 6 months ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆58Updated last year
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆193Updated this week
• Archermmt / tvm_walk_through
  code reading for tvm
  ☆69Updated 2 years ago
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆118Updated last year
• Ascend / AscendSpeed
  ☆70Updated 9 months ago
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆451Updated 6 months ago
• BBuf / how-to-optimize-gemm
  ☆92Updated 3 years ago