sandlogic / SandLogic-LexiconsLinks
SandLogic Lexicons
☆19Updated 2 weeks ago
Alternatives and similar repositories for SandLogic-Lexicons
Users that are interested in SandLogic-Lexicons are comparing it to the libraries listed below
Sorting:
- Cray-LM unified training and inference stack.☆22Updated 7 months ago
- ☆97Updated last month
- Full End-to-End examples showing how to use First-gen Gaudi and Gaudi2 in common use cases☆12Updated 9 months ago
- PB-LLM: Partially Binarized Large Language Models☆154Updated last year
- Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs☆110Updated last year
- Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs☆38Updated 10 months ago
- A collection of all available inference solutions for the LLMs☆91Updated 6 months ago
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆155Updated 11 months ago
- A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.☆179Updated 5 months ago
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆92Updated 2 years ago
- Collection of autoregressive model implementation☆86Updated 5 months ago
- An innovative library for efficient LLM inference via low-bit quantization☆348Updated last year
- Set of scripts to finetune LLMs☆38Updated last year
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated 2 months ago
- Notebooks for fine tuning pali gemma☆117Updated 5 months ago
- 👷 Build compute kernels☆147Updated this week
- ☆59Updated last year
- Model compression for ONNX☆97Updated 10 months ago
- A repository dedicated to evaluating the performance of quantizied LLaMA3 using various quantization methods..☆195Updated 8 months ago
- ☆44Updated 4 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated last week
- Google TPU optimizations for transformers models☆120Updated 8 months ago
- AI Edge Quantizer: flexible post training quantization for LiteRT models.☆67Updated this week
- LoRA and DoRA from Scratch Implementations☆212Updated last year
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆59Updated 2 months ago
- Fine tune Gemma 3 on an object detection task☆84Updated 2 months ago
- Notes on quantization in neural networks☆100Updated last year
- 🤝 Trade any tensors over the network☆30Updated 2 years ago
- Explore training for quantized models☆24Updated 2 months ago
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆315Updated this week