gf712 / gpt2-cppLinks
GPT2 implementation in C++ using Ort
☆26Updated 4 years ago
Alternatives and similar repositories for gpt2-cpp
Users that are interested in gpt2-cpp are comparing it to the libraries listed below
Sorting:
- LLM training in simple, raw C/CUDA☆104Updated last year
- A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenci…☆313Updated last year
- Inference of Mamba models in pure C☆191Updated last year
- RWKV in nanoGPT style☆192Updated last year
- General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …☆52Updated 6 months ago
- Inference Llama 2 in one file of pure C++☆83Updated 2 years ago
- A minimalistic C++ Jinja templating engine for LLM chat templates☆170Updated 3 weeks ago
- Embeddings focused small version of Llama NLP model☆104Updated 2 years ago
- Experiments with BitNet inference on CPU☆54Updated last year
- Python bindings for ggml☆146Updated 11 months ago
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆293Updated last year
- A C++ port of karpathy/llm.c features a tiny torch library while maintaining overall simplicity.☆35Updated last year
- GGML implementation of BERT model with Python bindings and quantization.☆56Updated last year
- llama.cpp to PyTorch Converter☆34Updated last year
- ☆125Updated last year
- An innovative library for efficient LLM inference via low-bit quantization☆349Updated last year
- ggml implementation of embedding models including SentenceTransformer and BGE☆59Updated last year
- Fork of llama.cpp, extended for GPT-NeoX, RWKV-v4, and Falcon models☆28Updated 2 years ago
- Tiny Dream - An embedded, Header Only, Stable Diffusion C++ implementation☆265Updated last year
- Inference Llama/Llama2/Llama3 Modes in NumPy☆21Updated last year
- A converter and basic tester for rwkv onnx☆43Updated last year
- ☆68Updated 2 years ago
- tinygrad port of the RWKV large language model.☆45Updated 5 months ago
- Port of Microsoft's BioGPT in C/C++ using ggml☆85Updated last year
- Inference RWKV v7 in pure C.☆38Updated last week
- Fast and vectorizable algorithms for searching in a vector of sorted floating point numbers☆146Updated 8 months ago
- Clover: Quantized 4-bit Linear Algebra Library☆114Updated 7 years ago
- High-Performance SGEMM on CUDA devices☆97Updated 7 months ago
- Port of Meta's Encodec in C/C++☆224Updated 8 months ago
- asynchronous/distributed speculative evaluation for llama3☆39Updated last year