google / minjaLinks
A minimalistic C++ Jinja templating engine for LLM chat templates
☆157Updated 2 months ago
Alternatives and similar repositories for minja
Users that are interested in minja are comparing it to the libraries listed below
Sorting:
- GGML implementation of BERT model with Python bindings and quantization.☆55Updated last year
- GGUF implementation in C as a library and a tools CLI program☆274Updated 6 months ago
- Inference of Mamba models in pure C☆188Updated last year
- Simple high-throughput inference library☆120Updated 2 months ago
- C API for MLX☆117Updated this week
- Python bindings for ggml☆142Updated 10 months ago
- Port of Suno AI's Bark in C/C++ for fast inference☆52Updated last year
- asynchronous/distributed speculative evaluation for llama3☆39Updated 11 months ago
- Inference Llama/Llama2/Llama3 Modes in NumPy☆21Updated last year
- Lightweight Llama 3 8B Inference Engine in CUDA C☆47Updated 3 months ago
- LLM-based code completion engine☆193Updated 5 months ago
- LLM training in simple, raw C/CUDA☆99Updated last year
- 1.58 Bit LLM on Apple Silicon using MLX☆214Updated last year
- Experiments with BitNet inference on CPU☆54Updated last year
- Transformer GPU VRAM estimator☆66Updated last year
- Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.☆72Updated 5 months ago
- Thin wrapper around GGML to make life easier☆36Updated 3 weeks ago
- xet client tech, used in huggingface_hub☆124Updated this week
- Testing LLM reasoning abilities with family relationship quizzes.☆62Updated 5 months ago
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆288Updated last year
- ☆214Updated 5 months ago
- SIMD quantization kernels☆73Updated last week
- LLaVA server (llama.cpp).☆180Updated last year
- High-Performance SGEMM on CUDA devices☆97Updated 5 months ago
- General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …☆50Updated 4 months ago
- A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…☆128Updated 11 months ago
- TTS support with GGML☆127Updated 2 weeks ago
- First token cutoff sampling inference example☆30Updated last year
- Super-fast Structured Outputs☆330Updated last week
- Samples of good AI generated CUDA kernels☆84Updated last month