fblgit / model-similarity
Simple Model Similarities Analysis
☆20Updated 7 months ago
Related projects: ⓘ
- ☆75Updated 3 weeks ago
- ☆71Updated last year
- Small and Efficient Mathematical Reasoning LLMs☆69Updated 7 months ago
- ☆73Updated 8 months ago
- ☆21Updated 3 months ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆107Updated last year
- Low-Rank adapter extraction for fine-tuned transformers model☆154Updated 4 months ago
- ☆64Updated 3 months ago
- ☆48Updated 6 months ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆62Updated last year
- Evaluation and analysis code for LLM360☆75Updated 3 months ago
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ☆96Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆22Updated 6 months ago
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆81Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 2 months ago
- ☆42Updated 3 weeks ago
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆41Updated last year
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆72Updated 8 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆64Updated 2 months ago
- Set of scripts to finetune LLMs☆36Updated 5 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 3 months ago
- QuIP quantization☆41Updated 6 months ago
- ☆32Updated last year
- Data preparation code for CrystalCoder 7B LLM☆42Updated 4 months ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆74Updated 5 months ago
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆118Updated last week
- ☆109Updated last month
- Code for NeurIPS LLM Efficiency Challenge☆52Updated 5 months ago
- ☆48Updated 11 months ago