Const-me / CgmlLinks
GPU-targeted vendor-agnostic AI library for Windows, and Mistral model implementation.
☆57Updated 2 years ago
Alternatives and similar repositories for Cgml
Users that are interested in Cgml are comparing it to the libraries listed below
Sorting:
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- A JPEG Image Compression Service using Part Homomorphic Encryption.☆31Updated 10 months ago
- Mistral7B playing DOOM☆139Updated last year
- Richard is gaining power☆200Updated 7 months ago
- Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.☆21Updated 4 months ago
- Single-file, pure CUDA C implementation for running inference on Qwen3 0.6B GGUF. No Dependencies.☆22Updated 2 months ago
- ☆191Updated last year
- C++ raytracer that supports custom models. Supports running the calculations on the CPU using C++11 threads or in the GPU via CUDA.☆74Updated 3 years ago
- A playground to make it easy to try crazy things☆33Updated 2 months ago
- Wang Yi's GPT solution☆142Updated 2 years ago
- Heirarchical Navigable Small Worlds☆101Updated 5 months ago
- A CLI to manage install and configure llama inference implemenation in multiple languages☆65Updated 2 years ago
- throwaway GPT inference☆141Updated last year
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆104Updated last year
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated 2 years ago
- ☆166Updated last year
- ☆62Updated last year
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆125Updated 9 months ago
- ☆200Updated 8 months ago
- Docker-based inference engine for AMD GPUs☆231Updated last year
- Experiments with BitNet inference on CPU☆55Updated last year
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization, with PyTorch/CUDA☆42Updated last year
- Tiny Dream - An embedded, Header Only, Stable Diffusion C++ implementation☆266Updated 2 years ago
- A GPU Accelerated Binary Vector Store☆47Updated 11 months ago
- WebGPU LLM inference tuned by hand☆151Updated 2 years ago
- Radient turns many data types (not just text) into vectors for similarity search, RAG, regression analysis, and more.☆281Updated last month
- A BERT that you can train on a (gaming) laptop.☆209Updated 2 years ago
- Official implementation of "WhisperNER: Unified Open Named Entity and Speech Recognition"☆200Updated 11 months ago
- A graphics engine that executes entirely on the CPU☆225Updated last year
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆254Updated 2 years ago