ggml-org / p1
LLM-based code completion engine
β182Updated 2 months ago
Alternatives and similar repositories for p1:
Users that are interested in p1 are comparing it to the libraries listed below
- Extend the original llama.cpp repo to support redpajama model.β117Updated 7 months ago
- Python bindings for ggmlβ140Updated 7 months ago
- C++ implementation for π«StarCoderβ453Updated last year
- ggml implementation of BERTβ486Updated last year
- SoTA Transformers with C-backend for fast inference on your CPU.β311Updated last year
- WebGPU LLM inference tuned by handβ149Updated last year
- CLIP inference in plain C/C++ with no extra dependenciesβ490Updated 7 months ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRAβ123Updated last year
- tinygrad port of the RWKV large language model.β44Updated last month
- Falcon LLM ggml framework with CPU and GPU supportβ246Updated last year
- An implementation of bucketMul LLM inferenceβ216Updated 9 months ago
- A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenciβ¦β310Updated last year
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfacesβ135Updated 9 months ago
- Port of Meta's Encodec in C/C++β216Updated 4 months ago
- Inference of Mamba models in pure Cβ187Updated last year
- This is our own implementation of 'Layer Selective Rank Reduction'β234Updated 10 months ago
- β530Updated 5 months ago
- FlashAttention (Metal Port)β476Updated 6 months ago
- Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascriptβ577Updated 9 months ago
- C++ implementation for BLOOMβ809Updated last year
- Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)β565Updated last year
- Embeddings focused small version of Llama NLP modelβ103Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge promptsβ113Updated last year
- β412Updated last year
- Full finetuning of large language models without large memory requirementsβ94Updated last year
- GGUF implementation in C as a library and a tools CLI programβ264Updated 3 months ago
- β153Updated 9 months ago
- β40Updated 2 years ago
- Command-line script for inferencing from models such as MPT-7B-Chatβ101Updated last year
- Suno AI's Bark model in C/C++ for fast text-to-speech generationβ796Updated 5 months ago