ling0322 / libllm

Related projects ⓘ

Alternatives and complementary repositories for libllm

• daquexian / faster-rwkv
  ☆123Updated 11 months ago
• nihui / ruapu
  Detect CPU features with single-file
  ☆298Updated 3 weeks ago
• scarsty / ncnn-editor
  ncnn和pnnx格式编辑器
  ☆125Updated last month
• lrw04 / llama2.c-to-ncnn
  A converter for llama2.c legacy models to ncnn models.
  ☆82Updated 11 months ago
• lrw04 / tinyllamas-ncnn
  Inference TinyLlama models on ncnn
  ☆25Updated last year
• wangzhaode / mnn-stable-diffusion
  stable diffusion using mnn
  ☆64Updated last year
• MollySophia / rwkv-ncnn
  Infere RWKV on NCNN
  ☆48Updated 2 months ago
• MollySophia / rwkv-qualcomm
  Inference rwkv5 or rwkv6 with Qualcomm AI Engine Direct SDK
  ☆38Updated this week
• lucasjinreal / simpleocv
  Make a minimal OpenCV runable on any where, WIP
  ☆81Updated last year
• EdVince / NeRF-NCNN
  NeRF in NCNN with c++ & vulkan
  ☆67Updated last year
• tpoisonooo / cpp-syntactic-sugar
  cpp syntactic sugar
  ☆8Updated last month
• EdVince / llm-cpp
  ☆28Updated 3 months ago
• futz12 / uie_ncnn_windows
  UIE(Universal Information Extraction) infer by ncnn
  ☆11Updated 2 months ago
• EdVince / GPT2-ChineseChat-NCNN
  GPT2⚡NCNN⚡中文对话⚡x86⚡Android
  ☆79Updated 2 years ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆26Updated last month
• prajna-lang / prajna
  a program language for AI infrastructure
  ☆87Updated this week
• EdVince / diffusers-ncnn
  ☆82Updated last year
• AXERA-TECH / ax-llm
  Explore LLM model deployment based on AXera's AI chips
  ☆54Updated last week
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆60Updated 3 months ago
• pigirons / conv3x3_m1
  This is a demo how to write a high performance convolution run on apple silicon
  ☆52Updated 2 years ago
• nihui / riscv-v-toolchain
  prebuild package for cross compiling riscv
  ☆18Updated 2 years ago
• MegEngine / MegCC
  MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器
  ☆473Updated 3 weeks ago
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆48Updated 8 months ago
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X
  ☆125Updated this week
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆137Updated 2 months ago
• jinmingyi1998 / opencl_kernels
  An easy way to run, test, benchmark and tune OpenCL kernel files
  ☆23Updated last year
• keith2018 / TinyGPT
  Tiny C++11 GPT-2 inference implementation from scratch
  ☆47Updated 10 months ago
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆42Updated last year
• FeiGeChuanShu / ncnn_ppstructure
  ppstructure deploy by ncnn
  ☆25Updated 4 months ago
• huakunyang / SummerAsr
  SummerAsr 是一个基于C++的可独立编译且几乎没有额外依赖库的本地中文语音识别器。 Summer Asr is a Chinese automatic speech recognize project written with C++ that can be eas…
  ☆83Updated last year