Alternatives and similar repositories for meetups

Users that are interested in meetups are comparing it to the libraries listed below

• OpenPPL / ppl.llm.serving
  ☆129Updated 10 months ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated 2 years ago
• DeepLink-org / dlinfer
  ☆64Updated last week
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆58Updated 11 months ago
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆428Updated last year
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆201Updated 3 weeks ago
• Ascend / AscendSpeed
  ☆79Updated last year
• DeepLink-org / ditorch
  ☆24Updated 9 months ago
• Deep-Spark / DeepSparkHub
  DeepSparkHub selects hundreds of application algorithms and models, covering various fields of AI and general-purpose computing, to suppo…
  ☆69Updated last week
• zw0610 / zw0610.github.io
  ☆58Updated 5 years ago
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆267Updated 2 months ago
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆116Updated last year
• THUDM / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆39Updated 2 years ago
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆249Updated last year
• Tencent / KsanaLLM
  ☆508Updated last month
• FlagOpen / FlagCX
  ☆91Updated this week
• OpenPPL / ppl.nn.llm
  ☆139Updated last year
• OpenBMB / cpm_kernels
  ☆25Updated 2 years ago
• luchangli03 / export_llama_to_onnx
  export llama to onnx
  ☆136Updated 10 months ago
• InternLM / turbomind
  ☆97Updated 7 months ago
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆265Updated 2 months ago
• modelbox-ai / modelbox
  A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架，快速基于AI全栈服务、开发跨端边云的AI行业应用，支持GPU，…
  ☆157Updated last year
• OpenPPL / ppl.pmx
  ☆59Updated 11 months ago
• HandH1998 / QQQ
  QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.
  ☆144Updated 2 months ago
• DeepLink-org / AIChipBenchmark
  ☆31Updated this week
• volcengine / veGiantModel
  ☆219Updated 2 years ago
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆114Updated 5 months ago
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆132Updated 2 years ago
• tpoisonooo / llama.onnx
  LLaMa/RWKV onnx models, quantization and testcase
  ☆367Updated 2 years ago
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆294Updated 3 years ago