nyunAI / PruneGPT
☆53Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for PruneGPT
- A pipeline parallel training script for LLMs.☆83Updated this week
- entropix style sampling + GUI☆25Updated 3 weeks ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆112Updated last year
- Data preparation code for CrystalCoder 7B LLM☆42Updated 6 months ago
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated 10 months ago
- ☆41Updated 2 weeks ago
- A pipeline for LLM knowledge distillation☆78Updated 3 months ago
- ☆73Updated 10 months ago
- ☆72Updated last year
- A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.☆74Updated last month
- ☆94Updated 2 months ago
- This is the official repository for Inheritune.☆105Updated last month
- GPT-4 Level Conversational QA Trained In a Few Hours☆55Updated 3 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆113Updated 3 weeks ago
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆144Updated 9 months ago
- QuIP quantization☆46Updated 8 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated 10 months ago
- ☆64Updated 5 months ago
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆82Updated 2 months ago
- Data preparation code for Amber 7B LLM☆84Updated 6 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 6 months ago
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆74Updated 10 months ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆173Updated 4 months ago
- Low-Rank adapter extraction for fine-tuned transformers model☆162Updated 6 months ago
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆181Updated 3 weeks ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆129Updated 2 months ago
- Let's create synthetic textbooks together :)☆70Updated 9 months ago
- ☆73Updated this week
- ☆150Updated 4 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆29Updated 6 months ago