tcapelle / mixtral
Mixtral finetuning
☆19Updated last year
Alternatives and similar repositories for mixtral:
Users that are interested in mixtral are comparing it to the libraries listed below
- QLoRA for Masked Language Modeling☆21Updated last year
- ☆24Updated last year
- ☆19Updated 7 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- Testing paligemma2 finetuning on reasoning dataset☆18Updated 2 months ago
- ☆22Updated last year
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- ☆87Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- ☆67Updated 7 months ago
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…☆42Updated last year
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- ☆48Updated last year
- Chat Markup Language conversation library☆55Updated last year
- PyTorch implementation for MRL☆18Updated last year
- ☆48Updated 4 months ago
- ☆47Updated last year
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated last year
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆41Updated 11 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 8 months ago
- ☆20Updated last year
- A sample pattern for running CI tests on Modal☆15Updated 6 months ago
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated last year
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- A place to store reusable transformer components of my own creation or found on the interwebs☆48Updated last week
- ☆27Updated 4 months ago