UmerHA / quanting-notesLinks
I learn about and explain quantization
☆26Updated last year
Alternatives and similar repositories for quanting-notes
Users that are interested in quanting-notes are comparing it to the libraries listed below
Sorting:
- An introduction to LLM Sampling☆79Updated last year
- Collection of autoregressive model implementation☆85Updated 8 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- ☆86Updated last year
- in this repository, i'm going to implement increasingly complex llm inference optimizations☆75Updated 7 months ago
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆196Updated last year
- Efficient vector database for hundred millions of embeddings.☆211Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 2 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆232Updated last year
- ☆86Updated last year
- A comprehensive deep dive into the world of tokens☆227Updated last year
- ☆80Updated last year
- A collection of lightweight interpretability scripts to understand how LLMs think☆74Updated this week
- code for training & evaluating Contextual Document Embedding models☆201Updated 7 months ago
- ☆68Updated 7 months ago
- Cerule - A Tiny Mighty Vision Model☆68Updated last month
- ML/DL Math and Method notes☆65Updated 2 years ago
- ☆23Updated 2 years ago
- ☆19Updated last year
- ☆124Updated last year
- Seemless interface of using PyTOrch distributed with Jupyter notebooks☆57Updated 3 months ago
- ☆210Updated 6 months ago
- alternative way to calculating self attention☆18Updated last year
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆108Updated 9 months ago
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- ☆40Updated last year
- A miniature version of Modal☆21Updated last year
- Low memory full parameter finetuning of LLMs☆53Updated 5 months ago
- look how they massacred my boy☆63Updated last year
- Rust Implementation of micrograd☆53Updated last year