UmerHA / quanting-notesLinks
I learn about and explain quantization
☆26Updated last year
Alternatives and similar repositories for quanting-notes
Users that are interested in quanting-notes are comparing it to the libraries listed below
Sorting:
- An introduction to LLM Sampling☆79Updated last year
- Collection of autoregressive model implementation☆85Updated 8 months ago
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆149Updated 2 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- ☆86Updated last year
- Cerule - A Tiny Mighty Vision Model☆68Updated last month
- ☆19Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 2 months ago
- ☆68Updated 7 months ago
- ☆80Updated last year
- A collection of lightweight interpretability scripts to understand how LLMs think☆74Updated this week
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆196Updated last year
- Set of scripts to finetune LLMs☆38Updated last year
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆85Updated last year
- ☆86Updated last year
- in this repository, i'm going to implement increasingly complex llm inference optimizations☆75Updated 7 months ago
- Seemless interface of using PyTOrch distributed with Jupyter notebooks☆57Updated 3 months ago
- ☆124Updated last year
- Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya☆124Updated 4 months ago
- ☆36Updated 4 months ago
- alternative way to calculating self attention☆18Updated last year
- ☆23Updated 2 years ago
- ☆40Updated last year
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆108Updated 9 months ago
- Supercharge huggingface transformers with model parallelism.☆77Updated 5 months ago
- ☆63Updated last year
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆233Updated last year
- Lightweight tools for quick and easy LLM demo's☆28Updated last year
- ☆46Updated 8 months ago
- Low memory full parameter finetuning of LLMs☆53Updated 5 months ago