LLM implementation one matrix multiplication at a time
☆14Aug 8, 2024Updated 2 years ago
Alternatives and similar repositories for llm-from-scratch
Users that are interested in llm-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Llama causal LM fully recreated in LibTorch. Designed to be used in Unreal Engine 5☆17Sep 19, 2024Updated 2 years ago
- BERT&RoBERTa预训练代码，tensorflow和torch两种版本实现☆13Feb 8, 2023Updated 3 years ago
- 🔥[ICLR'26] Official repository for the paper "Long-Document QA with Chain-of-Structured-Thought and Fine-Tuned SLMs"☆12Apr 16, 2026Updated 6 months ago
- ☆17Jun 10, 2025Updated last year
- Testing paligemma2 finetuning on reasoning dataset☆18Dec 28, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆15Aug 31, 2023Updated 3 years ago
- AFlow & MathAI☆18Feb 24, 2025Updated last year
- WMMA GEMM in ROCm for RDNA GPUs☆20Sep 1, 2026Updated 2 months ago
- PyTorch extension enabling direct access to cuDNN-accelerated C++ convolution functions.☆13Mar 14, 2021Updated 5 years ago
- Training Codebase for Triadic Linear Attention☆16Sep 30, 2026Updated last month
- helper functions for processing and integrating visual language information with Qwen-VL Series Model☆17Aug 30, 2024Updated 2 years ago
- A parser for PTX 6.5☆13Jun 19, 2023Updated 3 years ago
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.☆21Jan 24, 2025Updated last year
- Memory Topology for GPUs☆20Oct 27, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 🎉My Collections of CUDA Kernels~☆11Jun 25, 2024Updated 2 years ago
- ☆11May 30, 2025Updated last year
- Officical repository for the paper“ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answering”(EMN…☆22Nov 16, 2024Updated last year
- [ICML 2025] LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models☆16Nov 4, 2025Updated last year
- FlagTree IR is forked from microsoft/triton-shared, which is a Shared Middle-Layer for Triton Compilation. It is used for FlagTree.☆11Updated this week
- Turn ONNX models into inspectable, transformable, and trainable PyTorch FX GraphModules☆13May 14, 2026Updated 5 months ago
- Container Traits for Modern C++☆30Oct 11, 2020Updated 6 years ago
- DataMosaic: Explainable and Verifiable Document-Based Data Analytics☆20Jun 30, 2025Updated last year
- ☆16Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Zero Dependency LibTorch Safetensors Loading and Storing in C++☆24Jul 12, 2024Updated 2 years ago
- A lightweight and highly extensible Agent framework☆26Aug 24, 2026Updated 2 months ago
- Inference Llama 2 with a model compiled to native code by TorchInductor☆14Feb 8, 2024Updated 2 years ago
- An extension library of WMMA API (Tensor Core API)☆115Jul 12, 2024Updated 2 years ago
- High Performance Int8 GEMM Kernels for SM80 and later GPUs.☆24Mar 11, 2025Updated last year
- easy-compiler 编译器祛魅☆17May 11, 2026Updated 5 months ago
- High Performance Grouped GEMM in PyTorch☆30May 10, 2022Updated 4 years ago
- ACPO: Python ML training/inference framework for LLVM optimizations☆15Jul 2, 2025Updated last year
- Specialized Parallel Linear Algebra, providing distributed GEMM functionality for specific matrix distributions with optional GPU acceler…☆33Jun 26, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Fingerprint the exact GPU you're running on, even among identical GPUs, from the order its atomic adds land in. 99.1% accuracy, survives …☆29Oct 30, 2026Updated last week
- ☆34Feb 3, 2025Updated last year
- Collection of scripts to build PyTorch and the domain libraries from source.☆14Sep 18, 2026Updated last month
- A PyTorch native automated mega-kernel compiler☆33Updated this week
- ☆34Sep 14, 2026Updated last month
- Tutorials of Extending and importing TVM with CMAKE Include dependency.☆16Oct 11, 2024Updated 2 years ago
- Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.☆14May 29, 2024Updated 2 years ago