OpenBMB / BMPrinciples
A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or laws in the future
☆275Updated last year
Related projects ⓘ
Alternatives and complementary repositories for BMPrinciples
- The related works and background techniques about Openai o1☆142Updated last week
- Paper List for In-context Learning 🌷☆171Updated 9 months ago
- ☆314Updated 4 months ago
- Efficient, Low-Resource, Distributed transformer implementation based on BMTrain☆242Updated 11 months ago
- papers related to LLM-agent that published on top conferences☆305Updated 9 months ago
- [ACL 2024] A Survey of Chain of Thought Reasoning: Advances, Frontiers and Future☆338Updated 4 months ago
- A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks☆252Updated 3 months ago
- Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.☆277Updated last year
- [ACL 2024] LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding☆671Updated 2 months ago
- An Awesome Collection for LLM Survey☆310Updated 2 months ago
- Collaborative Training of Large Language Models in an Efficient Way☆411Updated 2 months ago
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆106Updated last year
- ☆875Updated 3 months ago
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆307Updated 2 months ago
- Collection of training data management explorations for large language models☆286Updated 3 months ago
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆374Updated last month
- Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large …☆941Updated 2 months ago
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)☆316Updated last month
- Code for "Lion: Adversarial Distillation of Proprietary Large Language Models (EMNLP 2023)"☆201Updated 9 months ago
- Naive Bayes-based Context Extension☆313Updated last year
- awesome papers in LLM interpretability☆325Updated this week
- Paper collection on building and evaluating language model agents via executable language grounding☆339Updated 6 months ago
- The repository for the survey paper <<Survey on Large Language Models Factuality: Knowledge, Retrieval and Domain-Specificity>>☆327Updated 6 months ago
- A paper & resource list of large language models, including course, paper, demo, figures☆190Updated last year
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning☆218Updated last year
- Paper collections of retrieval-based (augmented) language model.☆230Updated 5 months ago
- AI Alignment: A Comprehensive Survey☆128Updated last year
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆230Updated 6 months ago
- OpenLLMWiki: Docs of OpenLLMAI. Survey, reproduction and domain/task adaptation of open source chatgpt alternatives/implementations. PiXi…☆248Updated 8 months ago
- Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs…☆434Updated 3 weeks ago