Alternatives and similar repositories for minja

Users that are interested in minja are comparing it to the libraries listed below

• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆115Updated 3 weeks ago
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆270Updated 4 months ago
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆52Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆186Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆55Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆141Updated 9 months ago
• apple / ml-recurrent-drafter
  ☆210Updated 4 months ago
• hscspring / llama.np
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆21Updated last year
• ml-explore / mlx-c
  C API for MLX
  ☆109Updated last month
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆94Updated 4 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆212Updated last year
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆99Updated last year
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆34Updated this week
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆30Updated this week
• PrimeIntellect-ai / pi-quant
  SIMD quantization kernels
  ☆70Updated this week
• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆131Updated last year
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆46Updated 2 months ago
• andrewkchan / yalm
  Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O
  ☆364Updated 4 months ago
• okuvshynov / llama_duo
  asynchronous/distributed speculative evaluation for llama3
  ☆38Updated 9 months ago
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆82Updated 10 months ago
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆44Updated this week
• ggerganov / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆30Updated last year
• ml-explore / mlx-onnx
  MLX support for the Open Neural Network Exchange (ONNX)
  ☆51Updated last year
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆117Updated this week
• jameswdelancey / llama3.c
  A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…
  ☆127Updated 10 months ago
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆88Updated 2 weeks ago
• foundation-model-stack / fms-extras
  ☆24Updated 8 months ago
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆67Updated 2 months ago
• huggingface / xet-core
  xet client tech, used in huggingface_hub
  ☆107Updated this week
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆65Updated this week