Alternatives and similar repositories for llama-inference:

Users that are interested in llama-inference are comparing it to the libraries listed below

• hscspring / llama.np
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆20Updated last year
• evintunador / minGemma
  a simplified version of Google's Gemma model to be used for learning
  ☆24Updated last year
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆20Updated 2 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆108Updated 3 months ago
• evintunador / triton_docs_tutorials
  making the official triton tutorials actually comprehensible
  ☆26Updated last month
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆53Updated last year
• KyujinHan / Sakura-SOLAR-DPO
  Sakura-SOLAR-DPO: Merge, SFT, and DPO
  ☆117Updated last year
• likejazz / llama3.cuda
  llama3.cuda is a pure C/CUDA implementation for Llama 3 model.
  ☆331Updated 10 months ago
• Oxen-AI / mamba-dive
  This is the code that went into our practical dive using mamba as information extraction
  ☆54Updated last year
• hkproj / triton-flash-attention
  ☆157Updated 3 months ago
• NetEase-FuXi / EETQ
  Easy and Efficient Quantization for Transformers
  ☆197Updated 2 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆178Updated last week
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆62Updated this week
• StableFluffy / EasyLLMFeaturePorter
  1-Click is all you need.
  ☆61Updated 11 months ago
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 5 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆42Updated 11 months ago
• sayakpaul / deploy-hf-tf-vision-models
  This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.
  ☆30Updated 2 years ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆198Updated 11 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆131Updated last month
• LucasPrietoAl / grokking-at-the-edge-of-numerical-stability
  ☆94Updated 3 months ago
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆65Updated 10 months ago
• cosmo3769 / Quantized-LLMs
  Quantization of LLMs and benchmarking.
  ☆10Updated last year
• hkproj / mistral-src-commented
  Reference implementation of Mistral AI 7B v0.1 model.
  ☆28Updated last year
• apple / ml-hypercloning
  ☆46Updated 5 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 11 months ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆187Updated last year
• jaymody / speculative-sampling
  Simple implementation of Speculative Sampling in NumPy for GPT-2.
  ☆93Updated last year
• ash-01xor / bpe.c
  Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
  ☆129Updated 5 months ago
• mallik3006 / LLM_fine_tuning_llama3_8b
  Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed
  ☆17Updated 10 months ago