xinyuwei-david / david-share

Related projects ⓘ

Alternatives and complementary repositories for david-share

• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆236Updated 8 months ago
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆350Updated 4 months ago
• pcg-mlp / KsanaLLM
  ☆290Updated last week
• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆211Updated this week
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆137Updated 2 months ago
• 01-ai / Descartes
  ☆100Updated 7 months ago
• modelscope / evalscope
  A streamlined and customizable framework for efficient large model evaluation and performance benchmarking
  ☆263Updated this week
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆76Updated 8 months ago
• alibaba / rtp-llm
  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
  ☆547Updated last month
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆178Updated this week
• QwenLM / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆124Updated 11 months ago
• liguodongiot / unify-easy-llm
  unify-easy-llm（ULM）旨在打造一个简易的一键式大模型训练工具，支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。
  ☆40Updated 3 months ago
• allwefantasy / byzer-llm
  Easy, fast, and cheap pretrain,finetune, serving for everyone
  ☆263Updated 2 weeks ago
• zhanshijinwat / Steel-LLM
  Train a 1B LLM with 1T tokens from scratch by personal
  ☆347Updated last week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆103Updated last week
• mindspore-lab / mindformers
  ☆145Updated this week
• SmartFlowAI / LLM101n-CN
  LLM101n: Let's build a Storyteller 中文版
  ☆119Updated 3 months ago
• IEIT-Yuan / Yuan2.0-M32
  Mixture-of-Experts (MoE) Language Model
  ☆180Updated 2 months ago
• intel / xFasterTransformer
  ☆381Updated last week
• the-seeds / imitater
  Imitate OpenAI with Local Models
  ☆85Updated 2 months ago
• triton-inference-server / vllm_backend
  ☆193Updated this week
• hengjiUSTC / learn-llm
  ☆85Updated 2 weeks ago
• InternLM / InternEvo
  InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…
  ☆310Updated this week
• SomeoneKong / llm_long_context_bench202405
  ☆28Updated 2 months ago
• owenliang / qwen-vllm
  通义千问VLLM推理部署DEMO
  ☆446Updated 7 months ago
• Jenqyang / LLM-Powered-RAG-System
  A collection of RAG systems powered by LLM.
  ☆138Updated 2 weeks ago
• ai408 / nlp-engineering
  专注于Python/C++/CUDA、ML/DL/RL和NLP/KG/DS/LLM领域的技术分享。
  ☆63Updated 4 months ago
• Glanvery / LLM-Travel
  欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。
  ☆269Updated 4 months ago
• OpenPPL / ppl.llm.serving
  ☆124Updated 2 weeks ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year