okuvshynov / llama_duo

Related projects ⓘ

Alternatives and complementary repositories for llama_duo

• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆179Updated 8 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆51Updated 9 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆43Updated this week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆94Updated this week
• spirobel / bunny-llama
  iterate quickly with llama.cpp hot reloading. use the llama.cpp bindings with bun.sh
  ☆46Updated last year
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆87Updated 6 months ago
• ggerganov / stable-diffusion.cpp
  Stable Diffusion in pure C/C++
  ☆60Updated last year
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆50Updated 7 months ago
• efeslab / fiddler
  Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆173Updated last week
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆187Updated this week
• IST-DASLab / QUIK
  Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024
  ☆173Updated 7 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆132Updated 2 months ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆10Updated 2 weeks ago
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆16Updated 9 months ago
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆35Updated 6 months ago
• iboB / git-lfs-download
  Download full or partial git-lfs repos without temporarily using 2x disk space
  ☆30Updated last year
• nomic-ai / kompute
  General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …
  ☆41Updated last month
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆88Updated 9 months ago
• triton-lang / triton-cpu
  An experimental CPU backend for Triton
  ☆56Updated last week
• apple / ml-recurrent-drafter
  ☆101Updated last month
• mscheong01 / speculative_decoding.c
  minimal C implementation of speculative decoding based on llama2.c
  ☆17Updated 4 months ago
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA / Triton
  ☆147Updated this week
• Cornell-RelaxML / qtip
  ☆71Updated this week
• NolanoOrg / SpectraSuite
  ☆44Updated 4 months ago
• triton-lang / kernels
  ☆49Updated 2 weeks ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆56Updated last month
• iree-org / iree-turbine
  IREE's PyTorch Frontend, based on Torch Dynamo.
  ☆56Updated this week
• cchan / tccl
  extensible collectives library in triton
  ☆72Updated 2 months ago
• rahuldshetty / starcoder.js
  Web browser version of StarCoder.cpp
  ☆43Updated last year