huggingface / optimum-furiosaLinks
Accelerated inference of 🤗 models using FuriosaAI NPU chips.
☆26Updated 4 months ago
Alternatives and similar repositories for optimum-furiosa
Users that are interested in optimum-furiosa are comparing it to the libraries listed below
Sorting:
- ☆170Updated 8 months ago
- Blazing fast training of 🤗 Transformers on Graphcore IPUs☆85Updated last year
- [WIP] A 🔥 interface for running code in the cloud☆85Updated 2 years ago
- Google TPU optimizations for transformers models☆121Updated 9 months ago
- Hugging Face's Zapier Integration 🤗⚡️☆48Updated 2 years ago
- **ARCHIVED** Filesystem interface to 🤗 Hub☆58Updated 2 years ago
- Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs☆110Updated last year
- ☆29Updated 2 years ago
- ☆269Updated last week
- ☆51Updated 2 years ago
- Python bindings for ggml☆146Updated last year
- FRP Fork☆175Updated 6 months ago
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub☆160Updated 2 years ago
- ☆50Updated 2 years ago
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆318Updated last month
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆199Updated last week
- ☆20Updated last week
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆63Updated 2 years ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆277Updated last year
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆45Updated last year
- experiments with inference on llama☆103Updated last year
- Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.☆70Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆266Updated last year
- ☆66Updated 3 years ago
- ☆13Updated 2 years ago
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆91Updated 2 years ago
- Aana SDK is a powerful framework for building AI enabled multimodal applications.☆53Updated 2 months ago
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ☆102Updated 2 years ago
- Developing tools to automatically analyze datasets☆75Updated last year
- ☆22Updated 2 years ago