Alternatives and similar repositories for minja:

Users that are interested in minja are comparing it to the libraries listed below

• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆188Updated last year
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆90Updated 3 months ago
• okuvshynov / llama_duo
  asynchronous/distributed speculative evaluation for llama3
  ☆39Updated 8 months ago
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆94Updated last year
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆269Updated 3 months ago
• apple / ml-recurrent-drafter
  ☆209Updated 3 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆140Updated 8 months ago
• hscspring / llama.np
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆20Updated last year
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆30Updated last year
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆53Updated last year
• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆128Updated last year
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆47Updated last month
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆66Updated last month
• yachty66 / gpu-benchmark
  Benchmark your GPU with ease
  ☆15Updated this week
• guidance-ai / llguidance
  Super-fast Structured Outputs
  ☆213Updated this week
• huggingface / kernels
  Load compute kernels from the Hub
  ☆115Updated 2 weeks ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆204Updated 11 months ago
• ggml-org / p1
  LLM-based code completion engine
  ☆185Updated 3 months ago
• andrewkchan / yalm
  Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O
  ☆290Updated 3 months ago
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆79Updated 9 months ago
• jameswdelancey / llama3.c
  A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…
  ☆125Updated 9 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆186Updated 10 months ago
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆187Updated this week
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆59Updated last year
• facebookresearch / vector_db_id_compression
  Implementation of the paper "Lossless Compression of Vector IDs for Approximate Nearest Neighbor Search" by Severo et al.
  ☆78Updated 3 months ago
• LeanModels / DFloat11
  ☆306Updated 2 weeks ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆217Updated 10 months ago
• AmeyaWagh / llama2.cpp
  Inference Llama 2 in C++
  ☆44Updated last year
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆27Updated this week