Alternatives and similar repositories for lecture2

Users that are interested in lecture2 are comparing it to the libraries listed below

• gpu-mode / profiling-cuda-in-torch
  ☆159Updated last year
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆112Updated 3 weeks ago
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆59Updated 2 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆71Updated last year
• hkproj / triton-flash-attention
  ☆174Updated 5 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• apple / ml-recurrent-drafter
  ☆213Updated 5 months ago
• ulrichstern / cuda-convnet
  Alex Krizhevsky's original code from Google Code
  ☆192Updated 9 years ago
• snowflakedb / ArcticInference
  ☆159Updated this week
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• kabir2505 / tiny-mixtral
  ☆41Updated last month
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated 8 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated 10 months ago
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆185Updated last year
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆378Updated 2 weeks ago
• andrewkchan / yalm
  Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O
  ☆377Updated 2 weeks ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆204Updated last year
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆99Updated last year
• huggingface / picotron_tutorial
  ☆193Updated 4 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆238Updated 5 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆152Updated 3 months ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆91Updated last year
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆119Updated this week
• triton-inference-server / triton_cli
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…
  ☆64Updated 2 weeks ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆322Updated last week
• ksm26 / Efficiently-Serving-LLMs
  Learn the ins and outs of efficiently serving Large Language Models (LLMs). Dive into optimization techniques, including KV caching and L…
  ☆16Updated last year
• Deep-Learning-Profiling-Tools / triton-viz
  ☆219Updated this week
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆61Updated last year
• huggingface / kernels
  Load compute kernels from the Hub
  ☆191Updated this week
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆304Updated 3 weeks ago