纯c++的全平台llm加速库,支持python调用,支持chatglm-6B, llama, baichuan, moss基座,x86 / ARM
☆12Jan 30, 2026Updated last month
Alternatives and similar repositories for fastllm
Users that are interested in fastllm are comparing it to the libraries listed below
Sorting:
- Inference deployment of the llama3☆11Apr 21, 2024Updated last year
- Fastllm-based chatbot☆11May 19, 2023Updated 2 years ago
- ☆11Updated this week
- ☆32Jul 2, 2025Updated 8 months ago
- A simple WeChat Official Account layout tool based on Dify☆17Jun 27, 2025Updated 8 months ago
- ☆26Feb 28, 2026Updated last week
- Difyで作る生成AIアプリ完全入門☆17May 25, 2025Updated 9 months ago
- ☆28Dec 4, 2025Updated 3 months ago
- Write the database metadata into the dify knowledge☆12Dec 30, 2025Updated 2 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆12Nov 14, 2025Updated 3 months ago
- A full-stack AI-powered business intelligence tool for non-experts, featuring serverless backend processing and a secure Streamlit fronte…☆28Feb 13, 2026Updated 3 weeks ago
- ☆11Aug 29, 2025Updated 6 months ago
- Workflow automation, but you just describe what you want and it happens.☆27Nov 22, 2025Updated 3 months ago
- 参考《上海交通大学生存手册》开源☆16Sep 25, 2024Updated last year
- Java implementation for the Agent2Agent Protocol (A2A - https://github.com/google/A2A), enabling interaction between AI agents through a …☆11Apr 21, 2025Updated 10 months ago
- 🤖AI Agents for Financial Trading💰: LLM-Driven Stock Prediction & Investment Recommendation System☆13Apr 14, 2025Updated 10 months ago
- A package for filtering sensitive data (parameters, keys) from a variety of JS objects☆10Feb 17, 2026Updated 2 weeks ago
- A plugin for OpenCode. Make your coding agent learn and grow with every task.☆36Jan 31, 2026Updated last month
- This is a fork from Ryan Carson's AI Dev Tasks repository, with some code cleanup and refactoring to enable support for PostgreSQL databa…☆15Sep 8, 2025Updated 6 months ago
- ☆12Jun 28, 2024Updated last year
- Use the knowledge graph generated by GraphRAG as the external knowledge base for the Dify workflow.☆21Jun 4, 2025Updated 9 months ago
- Python Telegraph api.☆15Mar 22, 2025Updated 11 months ago
- LangReact 是一个配置化的 Planning Agent 应用开发工具,通过配置、插件,能快速为你的 GPT 应用提供 Planning 功能。☆12Apr 23, 2024Updated last year
- ☆10Dec 29, 2023Updated 2 years ago
- An SSH plugin for Dify☆13Jan 16, 2026Updated last month
- 知予人工智能:从学习者到研究者☆13Jan 20, 2025Updated last year
- A small framework to benchmark forecasting models via backtesting☆13Nov 25, 2023Updated 2 years ago
- ☆28Jun 27, 2025Updated 8 months ago
- dify 知识库检索工具☆13Apr 3, 2025Updated 11 months ago
- A universal skills runtime framework SDK for building, deploying, and executing modular capabilities across diverse environments.☆27Mar 3, 2026Updated last week
- A distilled DeepSeek-R1 variant built on Qwen2.5-32B, fine-tuned with curated data for enhanced performance and efficiency. <metadata> gp…☆16Mar 11, 2025Updated 11 months ago
- easyanimate generete videos with ExLlamaV2 quantization LLM prompt☆13Jun 26, 2024Updated last year
- A collection of concise notes on things I learn every day. Covering various topics, from tech to general knowledge. Quick insights for da…☆18Updated this week
- ☆14Apr 12, 2025Updated 10 months ago
- ☆12Nov 23, 2025Updated 3 months ago
- A simple AI developer agent☆22Jul 21, 2025Updated 7 months ago
- HearSight智能音视频内容分析工具,支持多源视频(包括 URL和上传文件方式)导入能够从输入的视频源中提取上下文信息,从而提供更精准的 AI问答交互。平台基于视频语义单元进行智能切片,用户可通过问答方式灵活调整切片维度,快速定位所需内容同时,HearSight支持自动…☆34Dec 12, 2025Updated 2 months ago
- 《Langchain编程:从入门到实践》书稿及演示代码仓库☆16Mar 17, 2025Updated 11 months ago
- 基于 Slidev 的 Dify 平台插件,可以将 Markdown 内容一键转换为 PPT 演示文稿。☆14Jul 15, 2025Updated 7 months ago