geronimi73 / qlora-minimal
☆79Updated 10 months ago
Related projects: ⓘ
- Just a bunch of benchmark logs for different LLMs☆112Updated last month
- inference code for mixtral-8x7b-32kseqlen☆97Updated 9 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆117Updated 8 months ago
- Low-Rank adapter extraction for fine-tuned transformers model☆154Updated 4 months ago
- ☆101Updated 6 months ago
- An automated tool for discovering insights from research papaer corpora☆131Updated 3 months ago
- ☆29Updated 6 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆81Updated last year
- ☆48Updated 11 months ago
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆192Updated 4 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆223Updated 4 months ago
- Scripts to create your own moe models using mlx☆86Updated 6 months ago
- ☆85Updated 7 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆217Updated 6 months ago
- A comprehensive repository of reasoning tasks for Medical LLMs (and beyond)☆81Updated this week
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆161Updated 8 months ago
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub☆154Updated 11 months ago
- GRDN.AI app for garden optimization☆68Updated 7 months ago
- ☆64Updated 3 months ago
- ☆82Updated 3 weeks ago
- RAFT, or Retrieval-Augmented Fine-Tuning, is a method comprising of a fine-tuning and a RAG-based retrieval phase. It is particularly sui…☆60Updated 3 weeks ago
- ☆89Updated 11 months ago
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆24Updated 7 months ago
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆260Updated last month
- ☆32Updated 7 months ago
- ☆144Updated 2 months ago
- Set of scripts to finetune LLMs☆36Updated 5 months ago
- Let's create synthetic textbooks together :)☆70Updated 7 months ago
- For inferring and serving local LLMs using the MLX framework☆77Updated 5 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆89Updated last week