ggml-org / p1

Related projects ⓘ

Alternatives and complementary repositories for p1

• abetlen / ggml-python
  Python bindings for ggml
  ☆132Updated 2 months ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆445Updated last year
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆464Updated 8 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆244Updated 9 months ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆131Updated 4 months ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆146Updated last year
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆312Updated 11 months ago
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆456Updated 2 months ago
• NouamaneTazi / bloomz.cpp
  C++ implementation for BLOOM
  ☆811Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated last year
• harrisonvanderbyl / rwkv-cpp-accelerated
  A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenci…
  ☆307Updated 9 months ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 2 months ago
• alasdairforsythe / tokenmonster
  Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript
  ☆550Updated 4 months ago
• Cornell-RelaxML / quip-sharp
  ☆501Updated last week
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆177Updated 8 months ago
• SkunkworksAI / hydra-moe
  ☆411Updated last year
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆177Updated last year
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆214Updated 4 months ago
• thomasantony / llamacpp-python
  Python bindings for llama.cpp
  ☆199Updated last year
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆102Updated last year
• PABannier / encodec.cpp
  Port of Meta's Encodec in C/C++
  ☆199Updated 2 weeks ago
• epfml / landmark-attention
  Landmark Attention: Random-Access Infinite Context Length for Transformers
  ☆415Updated 10 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 3 weeks ago
• zphang / minimal-llama
  ☆453Updated last year
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆231Updated 5 months ago
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆143Updated this week
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆382Updated last month
• apoorvumang / prompt-lookup-decoding
  ☆465Updated 2 months ago
• Cornell-RelaxML / QuIP
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"
  ☆346Updated 8 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆86Updated this week