cofe-ai / FLM-101B
☆12Updated last year
Alternatives and similar repositories for FLM-101B:
Users that are interested in FLM-101B are comparing it to the libraries listed below
- code for Scaling Laws of RoPE-based Extrapolation☆70Updated last year
- ☆17Updated last year
- ☆36Updated 6 months ago
- ☆45Updated 9 months ago
- An Experiment on Dynamic NTK Scaling RoPE☆62Updated last year
- SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2☆118Updated 4 months ago
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆76Updated last year
- Unleashing the Power of Cognitive Dynamics on Large Language Models☆60Updated 5 months ago
- ☆33Updated last year
- Code and data for CoachLM, an automatic instruction revision approach LLM instruction tuning.☆61Updated last year
- Unofficial implementation of AlpaGasus☆90Updated last year
- Code for KaLM-Embedding models☆74Updated this week
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆56Updated 11 months ago
- [ACL 24 Findings] Implementation of Resonance RoPE and the PosGen synthetic dataset.☆21Updated last year
- Reformatted Alignment☆114Updated 5 months ago
- [EMNLP 2023 Demo] CLEVA: Chinese Language Models EVAluation Platform☆62Updated last month
- FuseAI Project☆84Updated last month
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆75Updated last year
- Pytorch implementation of https://arxiv.org/html/2404.07143v1☆20Updated 11 months ago
- ☆29Updated 7 months ago
- Copy the MLP of llama3 8 times as 8 experts , created a router with random initialization,add load balancing loss to construct an 8x8b Mo…☆26Updated 8 months ago
- [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”☆121Updated 2 months ago
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆36Updated last year
- code for paper 《RankingGPT: Empowering Large Language Models in Text Ranking with Progressive Enhancement》☆31Updated last year
- the newest version of llama3,source code explained line by line using Chinese☆22Updated 11 months ago
- A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.☆84Updated last year
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"☆58Updated last year