tcapelle / mixtralLinks
Mixtral finetuning
☆19Updated last year
Alternatives and similar repositories for mixtral
Users that are interested in mixtral are comparing it to the libraries listed below
Sorting:
- QLoRA for Masked Language Modeling☆22Updated last year
- ☆47Updated 4 months ago
- ☆22Updated last year
- Testing paligemma2 finetuning on reasoning dataset☆18Updated 5 months ago
- LLM training in simple, raw C/CUDA☆14Updated 6 months ago
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…☆42Updated last year
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- ☆23Updated last year
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- ☆51Updated 7 months ago
- ☆23Updated last month
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- Simple GRPO scripts and configurations.☆58Updated 4 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- A sample pattern for running CI tests on Modal☆18Updated 2 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆53Updated 4 months ago
- ☆16Updated last year
- Chat Markup Language conversation library☆55Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 11 months ago
- 🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)☆17Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆58Updated last month
- PyTorch implementation for MRL☆18Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆57Updated 9 months ago
- ☆47Updated last year
- ☆28Updated this week
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆75Updated 8 months ago
- ☆38Updated 10 months ago
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated last year