Notes on quantization in neural networks
☆130Dec 14, 2023Updated 2 years ago
Alternatives and similar repositories for quantization-notes
Users that are interested in quantization-notes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Distributed training (multi-node) of a Transformer model☆99Apr 10, 2024Updated 2 years ago
- [TMLR] Official PyTorch implementation of paper "Quantization Variation: A New Perspective on Training Transformers with Low-Bit Precisio…☆49Sep 27, 2024Updated last year
- Slides for "Retrieval Augmented Generation" video☆27Nov 27, 2023Updated 2 years ago
- ☆256Jan 2, 2025Updated last year
- Notes and commented code for RLHF (PPO)☆136Feb 27, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- rabitq rust implementation☆11May 14, 2026Updated last month
- ☆34Mar 28, 2025Updated last year
- LLaMA 2 implemented from scratch in PyTorch☆372Sep 25, 2023Updated 2 years ago
- The official implementation of the DAC 2024 paper GQA-LUT☆23Dec 20, 2024Updated last year
- Repo of Machine Learning course in online master's program "Machine Learning and Data-Intensive Systems", CS faculty, HSE☆10Mar 16, 2024Updated 2 years ago
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆49May 24, 2024Updated 2 years ago
- ☆16Jan 14, 2025Updated last year
- BERT explained from scratch☆18Oct 26, 2023Updated 2 years ago
- Notes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)☆183Jan 7, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Papers on Search, Recommendations, and Ads (搜广推)☆34Jul 20, 2025Updated 11 months ago
- [ICLR 2025] DGQ: Distribution-Aware Group Quantization for Text-to-Image Diffusion Models☆19Mar 25, 2025Updated last year
- an example of local large langue model embeddings with Redis as vector stores☆12Apr 30, 2023Updated 3 years ago
- Reinforcement Learning example in Nim, playing tic tac toe. Based off original C version from the great Antirez☆15Apr 2, 2025Updated last year
- A blog for LLVM(v11.0.0) beginner, step by step, with detailed documents and comments. Record the way I learn LLVM.☆13Jun 17, 2022Updated 4 years ago
- ☆20Feb 12, 2025Updated last year
- MARs: Multi-view Attention Regularizations for Patch-based Feature Recognition of Space Terrain☆11Nov 20, 2024Updated last year
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- A Tensorflow implementation of VGG-16 trained on CIFAR-100☆11May 25, 2018Updated 8 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 𝐈𝐬𝐥𝐚𝐦𝐢𝐜𝐓𝐫𝐚𝐧𝐬𝐥𝐚𝐭𝐨𝐫 is an automated solution designed to translate 𝐇𝐚𝐝𝐢𝐭𝐡𝐬 into multiple languages using the power …☆11Jan 17, 2025Updated last year
- Attention is all you need implementation☆1,240Jun 8, 2024Updated 2 years ago
- Created a simple neural network using C++17 standard and the Eigen library that supports both forward and backward propagation.☆11Jul 27, 2024Updated last year
- Simple and efficient memory pool is implemented with C++11.☆10Jun 2, 2022Updated 4 years ago
- Notes on the Mistral AI model☆21Dec 27, 2023Updated 2 years ago
- PyLate efficient inference engine☆85Jan 7, 2026Updated 6 months ago
- ☆18Dec 23, 2025Updated 6 months ago
- Obsolete repo, merged into eynollah☆12Sep 29, 2025Updated 9 months ago
- Unveiling the Layers: Neural Networks from first principles☆10Oct 1, 2025Updated 9 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [ICML2025] LoRA fine-tune directly on the INT4 models.☆41Nov 25, 2024Updated last year
- Official implementation of the paper "Pretraining Language Models to Ponder in Continuous Space"☆26Jul 21, 2025Updated 11 months ago
- Sound Separation, Omni modal☆28Sep 15, 2025Updated 9 months ago
- 数据库内核笔记☆14Aug 18, 2022Updated 3 years ago
- Rebuttal code for SEGS-SLAM ICCV 2025☆18Jun 30, 2025Updated last year
- Twitch OBS overlay that shows location, date and time☆18Mar 27, 2023Updated 3 years ago
- Terminal UI for NVIDIA Nsight Systems profiles — timeline viewer, kernel navigator, NVTX hierarchy☆62Jun 18, 2026Updated 3 weeks ago