SkyworkAI / Skywork
Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sourced the model, training data, evaluation data, evaluation methods, etc. 天工系列模型在3.2TB高质量多语言和代码数据上进行预训练。我们开源了模型参数，训练数据，评估数据，评估方法。
☆1,222Updated 7 months ago
Related projects ⓘ
Alternatives and complementary repositories for Skywork
- Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]☆1,632Updated last year
- Tuning LLMs with no tears💦; Sample Design Engineering (SDE) for more efficient downstream-tuning.☆967Updated 6 months ago
- TigerBot: A multi-language multi-task LLM☆2,239Updated 5 months ago
- 中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sft微调，给出三元组信息抽取微调示例。☆1,228Updated 6 months ago
- Repo for adapting Meta LlaMA2 in Chinese! META最新发布的LlaMA2的汉化版！ （完全 开源可商用）☆747Updated last year
- XVERSE-13B: A multilingual large language model developed by XVERSE Technology Inc.☆650Updated 7 months ago
- CMMLU: Measuring massive multitask language understanding in Chinese☆694Updated this week
- A 13B large language model developed by Baichuan Intelligent Technology☆2,981Updated last year
- Yuan 2.0 Large Language Model☆680Updated 3 months ago
- 人工精调的中文对话数据集和一段chatglm的微调代码☆1,155Updated 6 months ago
- chatglm 6b finetuning and alpaca finetuning☆1,538Updated 6 months ago
- 基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型，进行下游具体任务微调，涉及Freeze、Lora、P-tuning、全参微调等☆2,659Updated 10 months ago
- 【LLMs九层妖塔】分享 LLMs在自然语言处理（ChatGLM、Chinese-LLaMA-Alpaca、小羊驼 Vicuna、LLaMA、GPT4ALL等）、信息检索（langchain）、语言合成、语言识别、多模态等领域（Stable Diffusion、MiniGP…☆1,785Updated 7 months ago
- Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集☆3,029Updated 6 months ago
- 中文Mixtral-8x7B（Chinese-Mixtral-8x7B）☆641Updated 2 months ago
- 中文nlp解决方案(大模型、数据、模型、训练、推理)☆2,952Updated last week
- Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、…☆5,834Updated 2 weeks ago
- Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.☆482Updated 3 months ago
- The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.☆436Updated 3 weeks ago
- 轩辕：度小满中文金融对话大模型☆1,061Updated last month
- A series of large language models developed by Baichuan Intelligent Technology☆4,086Updated this week
- 纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行☆3,310Updated this week
- Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调☆3,665Updated last year
- 中文法律LLaMA (LLaMA for Chinese legel domain)☆850Updated 2 months ago
- Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.☆575Updated 3 months ago
- HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance☆1,511Updated last week
- unified embedding model☆828Updated last year
- 中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）☆581Updated 6 months ago
- An open-source educational chat model from ICALK, East China Normal University. 开源中英教育对话大模型。(通用基座模型，GPU部署，数据清理) 致敬: LLaMA, MOSS, BELLE, Z…☆702Updated last month
- FinGLM: 致力于构建一个开放的、公益的、持久的金融大模型项目，利用开源开放来促进「AI+金融」。☆1,776Updated 6 months ago