victorsungo / WizardLM
Family of instruction-following LLMs powered by Evol-Instruct: WizardLM, WizardCoder
☆45Updated 7 months ago
Related projects ⓘ
Alternatives and complementary repositories for WizardLM
- FuseAI Project☆76Updated 3 months ago
- ☆78Updated 7 months ago
- Reformatted Alignment☆112Updated last month
- ☆78Updated 2 months ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆126Updated 5 months ago
- Code and data for CoachLM, an automatic instruction revision approach LLM instruction tuning.☆58Updated 8 months ago
- Code for paper titled "Towards the Law of Capacity Gap in Distilling Language Models"☆95Updated 4 months ago
- My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"☆92Updated last year
- Expert Specialized Fine-Tuning☆145Updated last month
- An Experiment on Dynamic NTK Scaling RoPE☆61Updated 11 months ago
- Data preparation code for CrystalCoder 7B LLM☆42Updated 6 months ago
- ☆287Updated 2 months ago
- Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper☆124Updated 4 months ago
- Mixture-of-Experts (MoE) Language Model☆180Updated 2 months ago
- LongQLoRA: Extent Context Length of LLMs Efficiently☆159Updated last year
- Unofficial implementation of AlpaGasus☆84Updated last year
- [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”☆118Updated 4 months ago
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆34Updated 10 months ago
- Data preparation code for Amber 7B LLM☆83Updated 6 months ago
- The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"☆50Updated 7 months ago
- Self-Evolved Diverse Data Sampling for Efficient Instruction Tuning☆67Updated 11 months ago
- A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.☆76Updated 9 months ago
- ☆42Updated 2 months ago
- [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement☆156Updated 7 months ago
- Self-Controlled Memory System for LLMs☆41Updated 6 months ago
- connecting humans and agents☆49Updated 2 weeks ago
- Hammer: Robust Function-Calling for On-Device Language Models via Function Masking☆33Updated this week
- XVERSE-65B: A multilingual large language model developed by XVERSE Technology Inc.☆132Updated 7 months ago
- This is the official repository for Inheritune.☆105Updated last month
- ☆83Updated 2 weeks ago
- code for Scaling Laws of RoPE-based Extrapolation☆70Updated last year