cosmo3769 / Quantized-LLMsLinks
Quantization of LLMs and benchmarking.
☆10Updated last year
Alternatives and similar repositories for Quantized-LLMs
Users that are interested in Quantized-LLMs are comparing it to the libraries listed below
Sorting:
- Collection of autoregressive model implementation☆86Updated 5 months ago
- Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.☆37Updated 2 years ago
- Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs☆38Updated 11 months ago
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆96Updated 9 months ago
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆92Updated 2 years ago
- Notebooks for fine tuning pali gemma☆117Updated 5 months ago
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.☆30Updated 3 years ago
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆48Updated last year
- ☆23Updated 2 years ago
- ☆42Updated last year
- Fine tune Gemma 3 on an object detection task☆84Updated 2 months ago
- ☆59Updated last year
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated 2 months ago
- Repository containing awesome resources regarding Hugging Face tooling.☆48Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated last year
- MatFormer repo☆62Updated 9 months ago
- RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems☆131Updated 8 months ago
- ML/DL Math and Method notes☆63Updated last year
- ☆52Updated 11 months ago
- Various transformers for FSDP research☆38Updated 2 years ago
- A byte-level decoder architecture that matches the performance of tokenized Transformers.☆66Updated last year
- ☆48Updated last year
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆99Updated last year
- ☆29Updated 2 months ago
- ☆46Updated last year
- Visualize multi-model embedding spaces. The first goal is to quickly get a lay of the land of any embedding space. Then be able to scroll…☆28Updated last year
- Notebooks to demonstrate TimmWrapper☆16Updated 8 months ago
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated 4 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Updated last year