Alternatives and similar repositories for ascend-docker-image:

Users that are interested in ascend-docker-image are comparing it to the libraries listed below

• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆78Updated 9 months ago
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆139Updated this week
• Ascend / AscendSpeed
  ☆75Updated last year
• AliyunContainerService / arena
  A CLI for Kubeflow.
  ☆59Updated 11 months ago
• OpenPPL / ppl.llm.serving
  ☆126Updated 3 weeks ago
• mindspore-lab / mindformers
  ☆150Updated last week
• mindspore-lab / mindpet
  ☆45Updated 9 months ago
• zw0610 / zw0610.github.io
  ☆56Updated 4 years ago
• xinyuwei-david / david-share
  ☆156Updated this week
• BGBiao / gpu-monitoring-tools
  Tools for monitoring NVIDIA GPUs on Linux
  ☆9Updated 4 years ago
• second-state / meetups
  ☆69Updated last year
• 01-ai / Descartes
  ☆101Updated 8 months ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year
• luchangli03 / export_llama_to_onnx
  export llama to onnx
  ☆103Updated 6 months ago
• pcg-mlp / KsanaLLM
  ☆295Updated last week
• void-main / fastertransformer_backend
  ☆21Updated last year
• 4paradigm / openaios-platform
  OpenAIOS is an incubating open-source distributed OS kernel based on Kubernetes for AI workloads. OpenAIOS-Platform is an AI development…
  ☆95Updated 3 years ago
• alibaba / FastNN
  FastNN provides distributed training examples that use EPL.
  ☆83Updated 2 years ago
• volcengine / veGiantModel
  ☆210Updated last year
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆195Updated this week
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆48Updated 9 months ago
• OpenBMB / cpm_kernels
  ☆23Updated last year
• OpenPPL / ppl.nn.llm
  ☆140Updated 7 months ago
• aliyun / alibabacloud-aiacc-demo
  alibabacloud-aiacc-demo
  ☆42Updated last year
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆360Updated 4 months ago
• alibaba / rtp-llm
  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
  ☆556Updated 2 months ago
• pokerfaceSad / GPUMounter
  A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod
  ☆121Updated 2 years ago
• PaddlePaddle / PaddleFlow
  ☆116Updated last month
• Project-HAMi / volcano-vgpu-device-plugin
  Device-plugin for volcano vgpu which support hard resource isolation
  ☆54Updated this week
• QwenLM / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆126Updated last week