Alternatives and similar repositories for Cgml:

Users that are interested in Cgml are comparing it to the libraries listed below

• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• ryao / llama3.c
  A fork of llama3.c used to do some R&D on inferencing
  ☆19Updated 3 months ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆53Updated 11 months ago
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆47Updated 7 months ago
• jmward01 / lmplay
  A playground to make it easy to try crazy things
  ☆33Updated last week
• mikepapadim / llama-shepherd-cli
  A CLI to manage install and configure llama inference implemenation in multiple languages
  ☆65Updated last year
• maxilevi / raytracer
  C++ raytracer that supports custom models. Supports running the calculations on the CPU using C++11 threads or in the GPU via CUDA.
  ☆75Updated 2 years ago
• charstorm / llmbinge
  A web-app to explore topics using LLM (less typing and more clicks)
  ☆66Updated last year
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆215Updated 8 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated 11 months ago
• symisc / tiny-dream
  Tiny Dream - An embedded, Header Only, Stable Diffusion C++ implementation
  ☆257Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• xetdata / onnx-models
  A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.
  ☆104Updated last year
• usefulsensors / qc_npu_benchmark
  Code sample showing how to run and benchmark models on Qualcomm's Window PCs
  ☆95Updated 5 months ago
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆53Updated 11 months ago
• robjinman / richard
  Richard is gaining power
  ☆184Updated 3 months ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆149Updated last year
• a1k0n / a1gpt
  throwaway GPT inference
  ☆140Updated 9 months ago
• carsonpo / haystackdb
  ☆163Updated 9 months ago
• recmo / cria
  Tiny inference-only implementation of LLaMA
  ☆92Updated 11 months ago
• cjpais / whisperfile
  ☆53Updated 7 months ago
• KienTTran / ABMGPU
  Agent Based Model on GPU using CUDA 12.2.1 and OpenGL 4.5 (CUDA OpenGL interop) on Windows/Linux
  ☆70Updated 2 weeks ago
• RichardKelley / hflm
  A simple library for working with Hugging Face models.
  ☆14Updated 2 months ago
• kuprel / minbpe-pytorch
  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization, with PyTorch/CUDA
  ☆36Updated last year
• blackhole89 / autopen
  Editor with LLM generation tree exploration
  ☆65Updated last month
• Netwrck / stable-diffusion-server
  Image Generation API Server - Similar to https://text-generator.io but for images
  ☆50Updated 3 months ago
• Verdagon / Anima
  33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU
  ☆13Updated 10 months ago
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆178Updated last year
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆47Updated 2 weeks ago