gf712 / gpt2-cpp
GPT2 implementation in C++ using Ort
☆26Updated 4 years ago
Alternatives and similar repositories for gpt2-cpp:
Users that are interested in gpt2-cpp are comparing it to the libraries listed below
- Experiments with BitNet inference on CPU☆53Updated last year
- LLM training in simple, raw C/CUDA☆92Updated 11 months ago
- Tiny C++11 GPT-2 inference implementation from scratch☆58Updated 2 weeks ago
- GGML implementation of BERT model with Python bindings and quantization.☆56Updated last year
- General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …☆46Updated 2 months ago
- Inference of Mamba models in pure C☆187Updated last year
- Inference Llama 2 in one file of pure C++☆83Updated last year
- qwen2 and llama3 cpp implementation☆44Updated 10 months ago
- RWKV in nanoGPT style☆189Updated 10 months ago
- Python bindings for ggml☆140Updated 7 months ago
- ☆124Updated last year
- Fork of llama.cpp, extended for GPT-NeoX, RWKV-v4, and Falcon models☆29Updated last year
- ☆65Updated 2 years ago
- Port of Suno AI's Bark in C/C++ for fast inference☆52Updated last year
- High-Performance SGEMM on CUDA devices☆90Updated 3 months ago
- Inference RWKV v7 in pure C.☆31Updated 3 weeks ago
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆266Updated last year
- A converter and basic tester for rwkv onnx☆42Updated last year
- Course Project for COMP4471 on RWKV☆17Updated last year
- Inference Llama/Llama2/Llama3 Modes in NumPy☆20Updated last year
- ☆68Updated 3 weeks ago
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆86Updated this week
- Using OpenAI's Whisper via whisper.cpp with SFML☆14Updated last year
- asynchronous/distributed speculative evaluation for llama3☆39Updated 8 months ago
- Train your own small bitnet model☆67Updated 6 months ago
- minimal C implementation of speculative decoding based on llama2.c☆22Updated 9 months ago
- GGUF parser in Python☆26Updated 8 months ago
- ggml implementation of embedding models including SentenceTransformer and BGE☆56Updated last year
- Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models☆35Updated last year
- Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs☆111Updated last year