cosmo3769 / Quantized-LLMsLinks
Quantization of LLMs and benchmarking.
☆10Updated last year
Alternatives and similar repositories for Quantized-LLMs
Users that are interested in Quantized-LLMs are comparing it to the libraries listed below
Sorting:
- Collection of autoregressive model implementation☆86Updated 6 months ago
- ☆42Updated last year
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆96Updated 10 months ago
- ☆124Updated 11 months ago
- Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.☆37Updated 2 years ago
- Notebooks for fine tuning pali gemma☆117Updated 6 months ago
- This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.☆30Updated 3 years ago
- Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs☆38Updated 11 months ago
- ☆45Updated 5 months ago
- ☆48Updated last year
- Repository containing awesome resources regarding Hugging Face tooling.☆48Updated last year
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆48Updated last year
- MatFormer repo☆64Updated 10 months ago
- ☆46Updated last year
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated 2 weeks ago
- ☆29Updated 3 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆50Updated last year
- ☆59Updated last year
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆92Updated 2 years ago
- ☆52Updated 11 months ago
- Google TPU optimizations for transformers models☆120Updated 9 months ago
- ☆23Updated 2 years ago
- ML/DL Math and Method notes☆64Updated last year
- Notebooks to demonstrate TimmWrapper☆16Updated 9 months ago
- Cray-LM unified training and inference stack.☆22Updated 8 months ago
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆84Updated last year
- I learn about and explain quantization☆26Updated last year
- Visualize multi-model embedding spaces. The first goal is to quickly get a lay of the land of any embedding space. Then be able to scroll…☆28Updated last year
- ☆15Updated last year