huggingface / hf_transferLinks
☆530Updated 2 months ago
Alternatives and similar repositories for hf_transfer
Users that are interested in hf_transfer are comparing it to the libraries listed below
Sorting:
- Official implementation of Half-Quadratic Quantization (HQQ)☆900Updated last month
- Gemma 2 optimized for your local machine.☆378Updated last year
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆315Updated 2 years ago
- ☆583Updated last year
- Beyond Language Models: Byte Models are Digital World Simulators☆334Updated last year
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆232Updated 6 months ago
- Python bindings for ggml☆146Updated last year
- A repository for research on medium sized language models.☆522Updated 6 months ago
- batched loras☆347Updated 2 years ago
- Inference code for Mistral and Mixtral hacked up into original Llama implementation☆371Updated 2 years ago
- Implementation of DoRA☆307Updated last year
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆202Updated last year
- Module, Model, and Tensor Serialization/Deserialization☆279Updated 4 months ago
- Comparison of Language Model Inference Engines☆238Updated last year
- FRP Fork☆176Updated 8 months ago
- scalable and robust tree-based speculative decoding algorithm☆365Updated 10 months ago
- OpenAI compatible API for TensorRT LLM triton backend☆218Updated last year
- ☆574Updated last year
- DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference☆572Updated 3 weeks ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆360Updated last year
- Long context evaluation for large language models☆224Updated 9 months ago
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆257Updated last year
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆279Updated 2 years ago
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆323Updated 2 months ago
- PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…☆294Updated last year
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆157Updated last year
- xet client tech, used in huggingface_hub☆356Updated this week
- Official inference library for pre-processing of Mistral models☆830Updated last week
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆155Updated last year
- A benchmark for emotional intelligence in large language models☆392Updated last year