Alternatives and similar repositories for minja:

Users that are interested in minja are comparing it to the libraries listed below

• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆47Updated 2 weeks ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆186Updated last year
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆92Updated 10 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• apple / ml-recurrent-drafter
  ☆203Updated 2 months ago
• hscspring / llama.np
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆20Updated last year
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆86Updated 2 months ago
• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆124Updated last year
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆261Updated 2 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆140Updated 6 months ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆53Updated 11 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆192Updated 10 months ago
• okuvshynov / llama_duo
  asynchronous/distributed speculative evaluation for llama3
  ☆39Updated 7 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆217Updated this week
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆53Updated 11 months ago
• mag- / gpu_benchmark
  Gpu benchmark
  ☆55Updated last month
• ml-explore / mlx-c
  C API for MLX
  ☆102Updated last week
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆215Updated 8 months ago
• AmeyaWagh / llama2.cpp
  Inference Llama 2 in C++
  ☆44Updated 10 months ago
• jameswdelancey / llama3.c
  A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…
  ☆123Updated 7 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆136Updated 7 months ago
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆178Updated last year
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆29Updated last year
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 5 months ago
• ggerganov / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆30Updated last year
• guidance-ai / llguidance
  Super-fast Structured Outputs
  ☆148Updated this week
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week