Pleias / Various-Finetuning
Set of scripts to finetune LLMs
☆37Updated 11 months ago
Alternatives and similar repositories for Various-Finetuning:
Users that are interested in Various-Finetuning are comparing it to the libraries listed below
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆35Updated 10 months ago
- ☆113Updated 5 months ago
- ☆65Updated 9 months ago
- ☆48Updated 4 months ago
- Prune transformer layers☆68Updated 9 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆59Updated last year
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆42Updated 9 months ago
- ☆110Updated 6 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆67Updated 4 months ago
- ☆126Updated 7 months ago
- Collection of autoregressive model implementation☆83Updated last month
- ☆53Updated 9 months ago
- A repository for research on medium sized language models.☆76Updated 9 months ago
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆26Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 8 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆196Updated 8 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆230Updated 4 months ago
- ☆47Updated 6 months ago
- This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data☆68Updated last year
- ☆24Updated last year
- Data preparation code for Amber 7B LLM☆86Updated 10 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- ☆48Updated last year
- An introduction to LLM Sampling☆77Updated 3 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆53Updated 11 months ago