nyunAI / PruneGPT
☆50Updated 3 months ago
Related projects: ⓘ
- A pipeline parallel training script for LLMs.☆79Updated 3 weeks ago
- A pipeline for LLM knowledge distillation☆68Updated last month
- ☆59Updated last week
- Low-Rank adapter extraction for fine-tuned transformers model☆154Updated 4 months ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆107Updated last year
- Data preparation code for CrystalCoder 7B LLM☆42Updated 4 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆123Updated 6 months ago
- LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.☆85Updated this week
- GPT-4 Level Conversational QA Trained In a Few Hours☆53Updated 3 weeks ago
- ☆73Updated 8 months ago
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆139Updated 7 months ago
- ☆71Updated last year
- ☆101Updated 5 months ago
- QuIP quantization☆41Updated 6 months ago
- A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.☆68Updated 2 months ago
- ☆86Updated 2 weeks ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆117Updated 8 months ago
- ☆75Updated 3 weeks ago
- Evaluation and analysis code for LLM360☆75Updated 3 months ago
- ☆144Updated 2 months ago
- ☆64Updated 3 months ago
- Just a bunch of benchmark logs for different LLMs☆112Updated last month
- ☆20Updated 11 months ago
- ☆82Updated 3 weeks ago
- Small and Efficient Mathematical Reasoning LLMs☆69Updated 7 months ago
- Expert Specialized Fine-Tuning☆129Updated last month
- ☆53Updated this week
- QLoRA: Efficient Finetuning of Quantized LLMs☆74Updated 5 months ago
- ☆35Updated last year
- Llama3.1 learns to Listen☆134Updated this week