huggingface / optimum-furiosaLinks
Accelerated inference of 🤗 models using FuriosaAI NPU chips.
☆26Updated 7 months ago
Alternatives and similar repositories for optimum-furiosa
Users that are interested in optimum-furiosa are comparing it to the libraries listed below
Sorting:
- ☆172Updated 11 months ago
- **ARCHIVED** Filesystem interface to 🤗 Hub☆58Updated 2 years ago
- [WIP] A 🔥 interface for running code in the cloud☆86Updated 2 years ago
- Blazing fast training of 🤗 Transformers on Graphcore IPUs☆87Updated last year
- Hugging Face's Zapier Integration 🤗⚡️☆49Updated 2 years ago
- FRP Fork☆177Updated 9 months ago
- Google TPU optimizations for transformers models☆135Updated last week
- ☆66Updated 3 years ago
- Python bindings for ggml☆147Updated last year
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆327Updated 4 months ago
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub☆161Updated 2 years ago
- ☆20Updated 3 weeks ago
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆205Updated this week
- Command-line script for inferencing from models such as MPT-7B-Chat☆100Updated 2 years ago
- Tune MPTs☆84Updated 2 years ago
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ☆101Updated 2 years ago
- ☆39Updated 3 years ago
- Full finetuning of large language models without large memory requirements☆94Updated 4 months ago
- manage histories of LLM applied applications☆91Updated 2 years ago
- ☆52Updated 2 years ago
- The package used to build the documentation of our Hugging Face repos☆135Updated this week
- experiments with inference on llama☆103Updated last year
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆280Updated 2 years ago
- ☆29Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆267Updated last month
- GitHub action that'll sync files from a GitHub Repo with the Hugging Face Hub 🤗☆79Updated last year
- Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs☆110Updated 2 years ago
- Drop in replacement for OpenAI, but with Open models.☆154Updated 2 years ago
- ☆34Updated 3 years ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆70Updated 2 years ago