cosmo3769 / Quantized-LLMs
Quantization of LLMs and benchmarking.
☆10Updated 8 months ago
Alternatives and similar repositories for Quantized-LLMs:
Users that are interested in Quantized-LLMs are comparing it to the libraries listed below
- Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs☆37Updated last month
- Notebooks for fine tuning pali gemma☆66Updated last week
- Collection of autoregressive model implementation☆67Updated 3 weeks ago
- ☆40Updated 7 months ago
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆85Updated 2 months ago
- This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.☆29Updated 2 years ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 5 months ago
- RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems☆85Updated 8 months ago
- Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.☆36Updated last year
- Code for NeurIPS LLM Efficiency Challenge☆54Updated 8 months ago
- Efficient CUDA kernels for training convolutional neural networks with PyTorch.☆37Updated 3 weeks ago
- ☆24Updated last year
- Experimentation on google's gemma model☆16Updated 9 months ago
- ☆24Updated 2 years ago
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆21Updated 4 months ago
- Repository containing awesome resources regarding Hugging Face tooling.☆43Updated 11 months ago
- Visualize multi-model embedding spaces. The first goal is to quickly get a lay of the land of any embedding space. Then be able to scroll…☆27Updated 7 months ago
- ☆58Updated 9 months ago
- A miniture AI training framework for PyTorch☆34Updated last year
- A collection of hand on notebook for LLMs practitioner☆39Updated 2 months ago
- ☆16Updated 9 months ago
- Build Agentic workflows with function calling☆20Updated 2 weeks ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 9 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆99Updated 2 months ago
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆47Updated 6 months ago
- This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…☆23Updated 11 months ago
- Set of scripts to finetune LLMs☆36Updated 8 months ago
- End-to-End LLM Guide☆97Updated 5 months ago
- Consists of the largest (10K) human annotated code-switched semantic parsing dataset & 170K generated utterance using the CST5 augmentati…☆33Updated last year