TylunasLi / fastllm
纯c++的全平台llm加速库，支持python调用，支持chatglm-6B, llama, baichuan, moss基座，x86 / ARM
☆9Updated last month
Related projects: ⓘ
- ☆37Updated 5 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆120Updated 9 months ago
- 介绍docker、docker compose的使用。☆20Updated 2 weeks ago
- gpt_server是一个用于生产级部署LLMs或Embedding的开源框架。☆94Updated this week
- Imitate OpenAI with Local Models☆83Updated 3 weeks ago
- 本项目用于Embedding模型的相关实验，包括Embedding模型评估、Embedding模型微调、Embedding模型量化等。☆18Updated 2 months ago
- 大模型检索增强生成技术最佳实践。☆30Updated 2 weeks ago
- ☆56Updated 5 months ago
- 打造人人都会的NLP，开源不易，记得star哦☆101Updated last year
- NLP 项目记录档案☆41Updated 3 weeks ago
- chatglm3base模型的有监督微调SFT☆73Updated 10 months ago
- bge推理优化相关脚本☆18Updated 7 months ago
- （1）弹性区间标准化的旋转位置词嵌入编码器+peft LORA量化训练，提高万级tokens性能支持。（2）证据理论解释学习，提升模型的复杂逻辑推理能力（3）兼容alpaca数据格式。☆45Updated last year
- ChatGLM2-6B微调, SFT/LoRA, instruction finetune☆107Updated last year
- LLM RAG 应用，支持 API 调用，语音交互。☆10Updated 2 months ago
- Just for debug☆55Updated 7 months ago
- aigc_serving lightweight and efficient Language service model reasoning☆23Updated 3 months ago
- qwen-7b and qwen-14b finetuning☆82Updated 5 months ago
- chatglm-6b微调/LORA/PPO/推理, 样本为自动生成的整数/小数加减乘除运算, 可gpu/cpu☆164Updated last year
- 演示 vllm 对中文大语言模型的神奇效果☆31Updated 10 months ago
- 大语言模型应用：RAG、NL2SQL、聊天机器人、预训练、MOE混合专家模型、微调训练、强化学习、天池数据竞赛☆48Updated 3 months ago
- share data， prompt data , pretraining data☆35Updated 9 months ago
- the newest version of llama3，source code explained line by line using Chinese☆21Updated 5 months ago
- Alpaca Chinese Dataset -- 中文指令微调数据集【人工+GPT4o持续更新】☆161Updated this week
- Qwen-WisdomVast is a large model trained on 1 million high-quality Chinese multi-turn SFT data, 200,000 English multi-turn SFT data, and …☆18Updated 5 months ago
- 使用qlora对中文大语言模型进行微调，包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE☆86Updated last year
- deep learning☆149Updated 2 months ago
- accelerate generating vector by using onnx model☆10Updated 7 months ago
- 使用langchain实现 故事情景生成，情感情景引导，剧情总结，性格分析☆13Updated 3 months ago
- 基于ChatGLM3基座模型和LLAMA-Factory框架进行微调的一个中医问答机器人☆64Updated 8 months ago