AlekseyKorshuk / role-play-synthetic
Synthetic Role-Play Conversation Dataset Generation
☆40Updated last year
Related projects ⓘ
Alternatives and complementary repositories for role-play-synthetic
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆144Updated 9 months ago
- A pipeline parallel training script for LLMs.☆83Updated this week
- Low-Rank adapter extraction for fine-tuned transformers model☆162Updated 6 months ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆77Updated 7 months ago
- An unsupervised model merging algorithm for Transformers-based language models.☆100Updated 6 months ago
- Sakura-SOLAR-DPO: Merge, SFT, and DPO☆115Updated 10 months ago
- ☆51Updated 3 months ago
- ☆53Updated 5 months ago
- Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper☆124Updated 4 months ago
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆74Updated 10 months ago
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆181Updated 3 weeks ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆112Updated last year
- FuseAI Project☆76Updated 3 months ago
- ☆73Updated 10 months ago
- An Open Source Toolkit For LLM Distillation☆358Updated 2 months ago
- ☆150Updated 4 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆130Updated 4 months ago
- Unofficial implementation of AlpaGasus☆84Updated last year
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆86Updated last year
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ☆97Updated last year
- ☆73Updated this week
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆199Updated 6 months ago
- This is the official repository for Inheritune.☆105Updated last month
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆196Updated 7 months ago
- A self-ailgnment method for role-play. Benchmark for role-play. Resources for "Large Language Models are Superpositions of All Characters…☆166Updated 5 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆113Updated 3 weeks ago
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- Official repo for "Make Your LLM Fully Utilize the Context"☆243Updated 6 months ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆232Updated 5 months ago