oKatanaaa / kolibrifyLinks
Curriculum training of instruction-following LLMs with Unsloth
☆14Updated 5 months ago
Alternatives and similar repositories for kolibrify
Users that are interested in kolibrify are comparing it to the libraries listed below
Sorting:
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- ☆134Updated 2 weeks ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆65Updated last year
- Crispy reranking models by Mixedbread☆34Updated last month
- ☆49Updated 6 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆270Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆175Updated last year
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆143Updated last month
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated last year
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated 11 months ago
- Google TPU optimizations for transformers models☆120Updated 7 months ago
- Set of scripts to finetune LLMs☆37Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 7 months ago
- Tokun to can tokens☆18Updated 2 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆84Updated this week
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆239Updated 10 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆83Updated last year
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆75Updated 2 years ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆78Updated 10 months ago
- ☆77Updated last year
- A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.☆44Updated last month
- QLoRA with Enhanced Multi GPU Support☆37Updated 2 years ago
- ☆118Updated last year
- ☆31Updated 9 months ago
- An introduction to LLM Sampling☆79Updated 8 months ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆200Updated last year
- ☆62Updated last year
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆186Updated last month
- ☆68Updated last month
- Just a bunch of benchmark logs for different LLMs☆120Updated last year