WalkerMitty / Fast-Llama2Links
Fast instruction tuning with Llama2
☆11Updated last year
Alternatives and similar repositories for Fast-Llama2
Users that are interested in Fast-Llama2 are comparing it to the libraries listed below
Sorting:
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆58Updated last year
- 大语言模型训练和服务调研☆37Updated 2 years ago
- 1.4B sLLM for Chinese and English - HammerLLM🔨☆43Updated last year
- OpenLLMDE: An open source data engineering framework for LLMs☆18Updated 2 years ago
- Code for "An Empirical Study of Retrieval Augmented Generation with Chain-of-Thought"☆17Updated last year
- Qwen1.5-SFT(阿里, Ali), Qwen_Qwen1.5-2B-Chat/Qwen_Qwen1.5-7B-Chat微调(transformers)/LORA(peft)/推理☆69Updated last year
- Deepseek-r1复现科普与资源汇总☆22Updated 10 months ago
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆67Updated 2 years ago
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆40Updated 2 years ago
- LLM+RAG for QA☆22Updated 2 years ago
- a toolkit on knowledge distillation for large language models☆249Updated 3 weeks ago
- SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper☆32Updated last year
- 最简易的R1结果在小模型上的复现,阐述类O1与DeepSeek R1最重要的本质。Think is all your need。利用实验佐证,对于强推理能力,think思考过程性内容是AGI/ASI的核心。☆45Updated 11 months ago
- Summarize all open source Large Languages Models and low-cost replication methods for Chatgpt.☆136Updated 2 years ago
- ☆26Updated 8 months ago
- the newest version of llama3,source code explained line by line using Chinese☆22Updated last year
- 官方transformers源码解析。AI大模型时代,pytorch、transformer是新操作系统,其他都是运行在其上面的软件。☆17Updated 2 years ago
- ☆174Updated last year
- SuperCLUE-Math6:新一代中文原生多轮多步数学推理数据集的探索之旅☆59Updated last year
- ☆93Updated 8 months ago
- code for paper 《RankingGPT: Empowering Large Language Models in Text Ranking with Progressive Enhancement》☆34Updated 2 years ago
- ☆50Updated last year
- code for Scaling Laws of RoPE-based Extrapolation☆73Updated 2 years ago
- Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…☆53Updated 2 years ago
- A GPT-based generative LM for combined text and math formulas, leveraging tree-based formula encoding. Published as "Tree-Based Represent…☆41Updated 2 years ago
- 本项目用于大模型数学解题能力方面的数据集合成,模型训练及评测,相关文章记录。☆100Updated last year
- ☆36Updated last year
- Awesome Colab Projects Collection☆29Updated 2 years ago
- Qwen-WisdomVast is a large model trained on 1 million high-quality Chinese multi-turn SFT data, 200,000 English multi-turn SFT data, and …☆18Updated last year
- make LLM easier to use☆59Updated 2 years ago