second-state / meetups

Related projects: ⓘ

• OpenPPL / ppl.llm.serving
  ☆123Updated 3 months ago
• Ascend / AscendSpeed
  ☆70Updated 9 months ago
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆188Updated 3 weeks ago
• Ascend / ascend-docker-image
  ☆19Updated 9 months ago
• luchangli03 / export_llama_to_onnx
  export llama to onnx
  ☆91Updated 3 months ago
• openppl-public / ppl.nn.llm
  ☆140Updated 4 months ago
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆71Updated 6 months ago
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆48Updated 6 months ago
• OpenPPL / ppl.pmx
  ☆56Updated last week
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆331Updated last month
• THUDM / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆39Updated last year
• OpenPPL / ppl.llm.kernel.cuda
  ☆133Updated 2 months ago
• pcg-mlp / KsanaLLM
  ☆251Updated last week
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆232Updated 6 months ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆58Updated last year
• luchangli03 / onnxsim_large_model
  simplify >2GB large onnx model
  ☆41Updated 6 months ago
• FlagOpen / FlagGems
  FlagGems is an operator library for large language models implemented in Triton Language.
  ☆246Updated last week
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X
  ☆103Updated this week
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆87Updated last year
• ModelTC / llmc
  This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit…
  ☆227Updated this week
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆129Updated last week
• zw0610 / zw0610.github.io
  ☆53Updated 4 years ago
• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆94Updated last month
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆20Updated 2 weeks ago
• mlc-ai / relax
  ☆148Updated this week
• 01-ai / Descartes
  ☆97Updated 5 months ago
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆41Updated last year
• mlc-ai / llm-perf-bench
  ☆110Updated 4 months ago
• alibaba / ChatLearn
  ☆105Updated last week