UmerHA / quanting-notesLinks
I learn about and explain quantization
☆26Updated last year
Alternatives and similar repositories for quanting-notes
Users that are interested in quanting-notes are comparing it to the libraries listed below
Sorting:
- An introduction to LLM Sampling☆79Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- Collection of autoregressive model implementation☆85Updated last week
- ☆86Updated last year
- Cerule - A Tiny Mighty Vision Model☆68Updated 2 months ago
- ☆23Updated 2 years ago
- Just a bunch of benchmark logs for different LLMs☆119Updated last year
- ☆40Updated last year
- ☆19Updated last year
- A collection of lightweight interpretability scripts to understand how LLMs think☆88Updated this week
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 3 months ago
- Efficient vector database for hundred millions of embeddings.☆211Updated last year
- alternative way to calculating self attention☆18Updated last year
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆83Updated 2 years ago
- Simple GRPO scripts and configurations.☆59Updated 11 months ago
- Set of scripts to finetune LLMs☆38Updated last year
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆150Updated 3 months ago
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆196Updated last year
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆109Updated 10 months ago
- in this repository, i'm going to implement increasingly complex llm inference optimizations☆81Updated 7 months ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆23Updated last year
- ☆68Updated 7 months ago
- A comprehensive deep dive into the world of tokens☆227Updated last year
- ☆63Updated last year
- Supercharge huggingface transformers with model parallelism.☆77Updated 5 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated 2 years ago
- ☆151Updated 4 months ago
- ☆38Updated 5 months ago
- code for training & evaluating Contextual Document Embedding models☆202Updated 8 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆233Updated last year