inclusionAI / Ling
Ling is a MoE LLM provided and open-sourced by InclusionAI.
☆120Updated this week
Alternatives and similar repositories for Ling:
Users that are interested in Ling are comparing it to the libraries listed below
- A flexible and efficient training framework for large-scale alignment tasks☆333Updated last month
- The RedStone repository includes code for preparing extensive datasets used in training large language models.☆125Updated last month
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆130Updated 9 months ago
- Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"☆230Updated last month
- ☆125Updated 3 weeks ago
- [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.☆237Updated 5 months ago
- ☆264Updated 8 months ago
- A Comprehensive Survey on Long Context Language Modeling☆113Updated last week
- ☆190Updated last month
- Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024☆55Updated 4 months ago
- Real-time updated, fine-grained reading list on LLM-synthetic-data.🔥☆246Updated 2 months ago
- Mixture-of-Experts (MoE) Language Model☆185Updated 6 months ago
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆180Updated last month
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆216Updated last week
- AutoCoA (Automatic generation of Chain-of-Action) is an agent model framework that enhances the multi-turn tool usage capability of reaso…☆75Updated 2 weeks ago
- From Hours to Minutes: Lossless Acceleration of Ultra Long Sequence Generation☆83Updated 2 weeks ago
- ☆206Updated last week
- Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning☆161Updated 2 weeks ago
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆247Updated 3 months ago
- Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs☆149Updated last week
- ☆312Updated 6 months ago
- Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718☆313Updated 6 months ago
- ☆81Updated 11 months ago
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆238Updated last year
- Distributed RL System for LLM Reasoning☆201Updated 3 weeks ago
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning☆248Updated last year
- ☆166Updated last year
- ☆262Updated 2 weeks ago
- ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models☆181Updated 5 months ago
- ☆143Updated 3 weeks ago