xinyuwei-david / david-share

Related projects: ⓘ

• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆331Updated last month
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆232Updated 6 months ago
• 01-ai / Descartes
  ☆97Updated 5 months ago
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆130Updated 3 weeks ago
• alibaba / ChatLearn
  ☆105Updated last week
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆71Updated 6 months ago
• alibaba / rtp-llm
  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
  ☆512Updated last week
• pcg-mlp / KsanaLLM
  ☆251Updated last week
• allwefantasy / byzer-llm
  Easy, fast, and cheap pretrain,finetune, serving for everyone
  ☆245Updated last week
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆129Updated last week
• IEIT-Yuan / Yuan2.0-M32
  Mixture-of-Experts (MoE) Language Model
  ☆179Updated last week
• the-seeds / imitater
  Imitate OpenAI with Local Models
  ☆83Updated 3 weeks ago
• intel / xFasterTransformer
  ☆348Updated 2 weeks ago
• mindspore-lab / mindformers
  ☆131Updated last week
• codefuse-ai / CodeFuse-muAgent
  An Innovative Agent Framework Driven by KG Engine
  ☆168Updated last week
• QwenLM / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆120Updated 9 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆95Updated this week
• allwefantasy / byzer-agent
  ☆30Updated 6 months ago
• aigc-apps / PAI-RAG
  An easy-to-use framework for modular RAG
  ☆279Updated last week
• Chinese-Tiny-LLM / Chinese-Tiny-LLM
  ☆196Updated 4 months ago
• NascentCore / llm-numbers-cn
  中文版 llm-numbers
  ☆94Updated 8 months ago
• triton-inference-server / vllm_backend
  ☆170Updated this week
• yongzhuo / LLM-SFT
  中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…
  ☆159Updated 4 months ago
• godaai / llm-inference
  Resources for Large Language Model Inference
  ☆14Updated 8 months ago
• leptonai / gpud
  ☆158Updated this week
• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆452Updated 8 months ago
• InternLM / InternEvo
  InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…
  ☆277Updated this week
• neuralmagic / AutoFP8
  ☆145Updated last month
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆370Updated last week
• bentoml / llm-bench
  ☆27Updated last month