Alternatives and similar repositories for scratch-llm

Users that are interested in scratch-llm are comparing it to the libraries listed below

• Hemanthkumar2112 / Reward-Modeling-RLHF-Finetune-and-RAG
  Gemma2(9B), Llama3-8B-Finetune-and-RAG, code base for sample, implemented in Kaggle platform
  ☆22Updated 8 months ago
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• geronimi73 / 3090_shorts
  minimal scripts for 24GB VRAM GPUs. training, inference, whatever
  ☆42Updated 2 weeks ago
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆105Updated last year
• modelize-ai / LLM-Inference-Deployment-Tutorial
  Tutorial for LLM developers about engine design, service deployment, evaluation/benchmark, etc. Provide a C/S style optimized LLM inferen…
  ☆19Updated 2 years ago
• FrancescoSaverioZuppichini / pytorch-2.0-benchmark
  Benchmarking PyTorch 2.0 different models
  ☆20Updated 2 years ago
• kailums / flash-attention-rocm
  Fast and memory-efficient exact attention ported to rocm
  ☆11Updated last year
• anyscale / long-context-fine-tuning-blogpost
  ☆17Updated last year
• Montinger / Transformer-Workbench
  Playground for Transformers
  ☆53Updated last year
• knotgrass / attention
  several types of attention modules written in PyTorch for learning purposes
  ☆52Updated last year
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆13Updated 9 months ago
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆56Updated 2 weeks ago
• lucasjinreal / wnnx_models
  Various test models in WNNX format. It can view with `pip install wnetron && wnetron`
  ☆12Updated 3 years ago
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆13Updated last year
• MILVLG / mlc-imp
  Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
  ☆12Updated last year
• cmd2001 / KVTuner
  KVTuner: Sensitivity-Aware Layer-wise Mixed Precision KV Cache Quantization for Efficient and Nearly Lossless LLM Inference
  ☆22Updated 4 months ago
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆19Updated 2 weeks ago
• AmeyaWagh / llama2.cpp
  Inference Llama 2 in C++
  ☆43Updated last year
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• keith2018 / TinyGPT
  Tiny C++ LLM inference implementation from scratch
  ☆66Updated last month
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆82Updated 2 years ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆98Updated 6 months ago
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated last year
• tridao / flash-attention-wheels
  ☆57Updated last year
• paperswithcode / model-index
  Create a source of truth for ML model results and browse it on Papers with Code
  ☆33Updated 4 years ago
• zaydzuhri / pythia-mlkv
  Multi-Layer Key-Value sharing experiments on Pythia models
  ☆34Updated last year
• apple / tensor-visualizer
  A Jupyter widget to visualize tensor data in notebooks.
  ☆59Updated last year
• casper-hansen / AutoAWQ_kernels
  ☆78Updated 10 months ago
• stxnext / visual-similarity-search
  Visual similarity search engine demo with use of PyTorch Metric Learning and Qdrant
  ☆12Updated 2 years ago
• TiledTensor / TiledBench
  Benchmark tests supporting the TiledCUDA library.
  ☆17Updated 10 months ago