TylunasLi / fastllmLinks
纯c++的全平台llm加速库,支持python调用,支持chatglm-6B, llama, baichuan, moss基座,x86 / ARM
☆10Updated this week
Alternatives and similar repositories for fastllm
Users that are interested in fastllm are comparing it to the libraries listed below
Sorting:
- 介绍docker、docker compose的使用。☆20Updated 9 months ago
- 使用langchain进行任务规划,构建子任务的会话场景资源,通过MCTS任务执行器,来让每个子任务通过在上下文中资源,通过自身反思探索来获取自身对问题的最优答案;这种方式依赖模型的对齐偏好,我们在每种偏好上设计了一个工程框架,来完成自我对不同答案的奖励进行采样策略☆29Updated last month
- ☆57Updated 7 months ago
- accelerate generating vector by using onnx model☆17Updated last year
- ☆144Updated last year
- the newest version of llama3,source code explained line by line using Chinese☆22Updated last year
- Qwen-Efficient-Tuning☆43Updated last year
- Imitate OpenAI with Local Models☆87Updated 9 months ago
- (1)弹性区间标准化的旋转位置词嵌入编码器+peft LORA量化训练,提高万级tokens性能支持。(2)证据理论解释学习,提升模型的复杂逻辑推理能力(3)兼容alpaca数据格式。☆44Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆136Updated 6 months ago
- NLP 项目记录档案☆54Updated last month
- share data, prompt data , pretraining data☆36Updated last year
- 部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ,实现了OpenAI中Chat, Models和Completions接口,包含流式响…☆93Updated last year
- ChatGPT WebUI using gradio. 给 LLM 对话和检索知识问答RAG提供一个简单好用的Web UI界面☆130Updated 9 months ago
- qwen models finetuning☆98Updated 2 months ago
- Qwen-WisdomVast is a large model trained on 1 million high-quality Chinese multi-turn SFT data, 200,000 English multi-turn SFT data, and …☆18Updated last year
- 使用Qwen1.5-0.5B-Chat模型进行通用信息抽取任务的微调,旨在: 验证生成式方法相较于抽取式NER的效果; 为新手提供简易的模型微调流程,尽量减少代码量; 大模型训练的数据格式处理。☆12Updated 9 months ago
- Python implementation of AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, w…☆45Updated 2 months ago
- 打造人人都会的NLP,开源不易,记得star哦☆101Updated 2 years ago
- 使用qlora对中文大语言模型进行微调,包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE☆86Updated last year
- 利用LLM+敏感词库,来自动判别是否涉及敏感词。☆124Updated last year
- chatglm-6B for tools application using langchain☆75Updated 2 years ago
- ChatGLM2-6B微调, SFT/LoRA, instruction finetune☆108Updated last year
- 收集优质的角色扮演聊天数据 | Collection of roleplay conversations of high quality☆12Updated 6 months ago
- ☆15Updated 11 months ago
- bge推理优化相关脚本☆28Updated last year
- 实现Blip2RWKV+QFormer的多模态图文对话大模型,使用Two-Step Cognitive Psychology Prompt方法,仅3B参数的模型便能够出现类人因果思维链。对标MiniGPT-4,ImageBind等图文对话大语言模型,力求以更小的算力和资源实…☆38Updated last year
- Tracking the hot Github repos and update daily 每天自动追踪Github热门项目☆49Updated this week
- Alpaca Chinese Dataset -- 中文指令微调数据集☆205Updated 8 months ago
- SearchGPT: Building a quick conversation-based search engine with LLMs.☆46Updated 5 months ago