UmerHA / quanting-notesLinks
I learn about and explain quantization
☆26Updated last year
Alternatives and similar repositories for quanting-notes
Users that are interested in quanting-notes are comparing it to the libraries listed below
Sorting:
- An introduction to LLM Sampling☆79Updated 11 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- Cerule - A Tiny Mighty Vision Model☆68Updated last month
- Collection of autoregressive model implementation☆85Updated 7 months ago
- ☆19Updated last year
- ☆23Updated 2 years ago
- ☆86Updated last year
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆196Updated last year
- ☆124Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated last month
- ☆63Updated last year
- Efficient vector database for hundred millions of embeddings.☆211Updated last year
- ☆86Updated last year
- ☆36Updated 4 months ago
- Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya☆123Updated 4 months ago
- A comprehensive deep dive into the world of tokens☆227Updated last year
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆84Updated last year
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆59Updated 2 months ago
- in this repository, i'm going to implement increasingly complex llm inference optimizations☆73Updated 6 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆232Updated last year
- Seemless interface of using PyTOrch distributed with Jupyter notebooks☆57Updated 2 months ago
- ☆210Updated 5 months ago
- Ongoing research training transformer models at scale☆38Updated last year
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆148Updated 2 months ago
- ☆80Updated last year
- alternative way to calculating self attention☆18Updated last year
- ML/DL Math and Method notes☆64Updated 2 years ago
- Because it's there.☆16Updated last year
- Supercharge huggingface transformers with model parallelism.☆77Updated 4 months ago
- Lightweight tools for quick and easy LLM demo's☆28Updated last year