Alternatives and similar repositories for llama-inference

Users that are interested in llama-inference are comparing it to the libraries listed below

• NetEase-FuXi / EETQ
  Easy and Efficient Quantization for Transformers
  ☆203Updated 2 months ago
• likejazz / llama3.cuda
  llama3.cuda is a pure C/CUDA implementation for Llama 3 model.
  ☆343Updated 4 months ago
• RahulSChand / llama2.c-for-dummies
  Step by step explanation/tutorial of llama2.c
  ☆223Updated last year
• StableFluffy / EasyLLMFeaturePorter
  1-Click is all you need.
  ☆62Updated last year
• KyujinHan / Sakura-SOLAR-DPO
  Sakura-SOLAR-DPO: Merge, SFT, and DPO
  ☆116Updated last year
• deep-diver / keras-sd-serving
  showing various ways to serve Keras based stable diffusion
  ☆111Updated 2 years ago
• apple / ml-hypercloning
  ☆50Updated 10 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆211Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆185Updated 6 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆120Updated 7 months ago
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆74Updated last week
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆232Updated 10 months ago
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆70Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆116Updated 2 years ago
• TheSeriousProgrammer / SimpleBitNet
  Simple Adaptation of BitNet
  ☆32Updated last year
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆121Updated last year
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆193Updated 3 months ago
• deep-diver / gpt2-ft-pipeline
  GPT2 fine-tuning pipeline with KerasNLP, TensorFlow, and TensorFlow Extended
  ☆33Updated 2 years ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆266Updated 11 months ago
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆161Updated 5 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆200Updated last year
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆98Updated last year
• huggingface / picotron_tutorial
  ☆216Updated 7 months ago
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆158Updated last year
• rcrowe-google / Learning-JAX
  Slide decks, coding exercises, and quick references for learning the JAX AI Stack
  ☆33Updated 2 weeks ago
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆38Updated 2 years ago
• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆184Updated last year
• hscspring / llama.np
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆21Updated last year
• kmohan321 / Research_Papers
  ☆46Updated 5 months ago
• lucidrains / ttt-rl
  Reinforcement Learning example in Nim, playing tic tac toe. Based off original C version from the great Antirez
  ☆14Updated 5 months ago