adoresever / PretuningLinks
A tool for creating pre-training datasets for language models, supporting one-click batch processing for both text and image datasets. 一个专为语言模型预训练设计的数据集制作工具，支持文本和图像数据集的一键式批量处理。
☆43Updated last year
Alternatives and similar repositories for Pretuning
Users that are interested in Pretuning are comparing it to the libraries listed below
Sorting:
- GraphRAG-Ollama-UI + GraphRAG4OpenWebUI 融合版（有gradio webui配置生成RAG索引，有fastapi提供RAG API服务）☆104Updated last year
- LightRAG与GraphRAG在索引构建、检索测试中的耗时、模型请求次数、Token消耗金额、检索质量等方面进行对比☆151Updated last year
- 添加🚀流式 Web 服务到 GraphRAG，兼容 OpenAI SDK，支持可访问的实体链接🔗，支持建议问题，兼容本地嵌入模型，修复诸多问题。Add streaming web server to GraphRAG, compatible with OpenAI SD…☆262Updated 9 months ago
- Convert files into markdown to help RAG or LLM understand, based on markitdown and MinerU, which could provide high quality pdf parser.☆130Updated 9 months ago
- A unified tool to generate fine-tuning datasets for LLMs, including questions, answers, and dialogues. ✨🤖📚💬☆62Updated 9 months ago
- 利用免费的大模型api来结合你的私域数据来生成sft训练数据（妥妥白嫖）支持llamafactory等工具的训练数据格式synthetic data☆190Updated last year
- ☆274Updated last year
- AutoGen最新架构v0.4正式发布第一个稳定版本，v0.4是对AutoGen的一次从头开始的重写，目的是为构建Agent创建一个更健壮、可扩展、更易用的跨语言库，其应用接口采用分层架构设计，存在多套软件接口用以满足不同的场景需求 。☆112Updated 8 months ago
- ✨🦋 illufly - 【幻蝶】基于记忆蒸馏、资料检索的自我进化智能体☆74Updated last month
- A learning project for building local knowledge bases from PDFs using LangChain, supporting multiple LLMs (DeepSeek, OpenAI). Features in…☆216Updated 11 months ago
- ☆36Updated 9 months ago
- 一个基于多模态向量模型及视觉多模态模型构建的图片搜索引擎&管理系统，实现精准的以文搜文，文搜图、以图搜图多种智能检索方式。An image search engine management system built upon multimodal vector models…☆76Updated 3 months ago
- Chat2Graph: Graph Native Agentic System.☆388Updated 2 months ago
- A low-code data flow tool that allows for convenient use of LLM and HuggingFace models, with some features considered as a low-code versi…☆314Updated 2 months ago
- Text2Neo4j 是一个遍历文档、从文本中提取关系并将其保存到 Neo4j 数据库中以形成知识图谱的工具。本项目结合了 Dify 和 LLaMA3.1（8B 模型）来高效处理和提取复杂关系。☆24Updated last year
- 全方位大模型评测知识库 | 提示词工程（Prompt Engineer）、各渠道大模型榜单（LeaderBoard）、标杆数据集、安全检测、对抗攻击、智能体、优质数据、文本分类、关系抽取、语音识别、语音合成、多模态、文本生成图片、文本生成视频、点云、智能对话、摘要总结、问答…☆79Updated last year
- [arxiv: 2503.23895] Dynamic Parametric Retrieval Augmented Generation for Test-time Knowledge Enhancement☆167Updated 4 months ago
- mcp的webui界面，支持客户端连接多个sse服务端，支持 openai、deepseek、qwen等大模型，另外附上构建的 agent的 stdio和sse的简单 天气查询的完整示例☆38Updated 7 months ago
- generate ppt with llm☆105Updated last year
- Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 构建智能的多模态AI Agent。☆229Updated last week
- 视频理解：千问视频多模态模型 & Dify☆66Updated last year
- 支持中文🇨🇳🇨🇳🇨🇳 的 microsoft/graphrag☆51Updated 9 months ago
- A LLM RAG system runs on your laptop. 大模型检索增强生成系统，可以轻松部署在笔记本电脑上，实现本地知识库智能问答。企业级SaaS版本请访问：☆300Updated 3 weeks ago
- VideoFinder is an advanced video analysis tool powered by multimodal AI, designed to help users easily locate and identify specific objec…☆167Updated last year
- ☆133Updated 9 months ago
- [EMNLP 2025] ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agents☆619Updated 6 months ago
- [ACL2025 demo track] ROGRAG: A Robustly Optimized GraphRAG Framework☆189Updated 3 weeks ago
- gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。☆243Updated 2 weeks ago
- A Dify tool plugin to export Markdown to DOCX, PPTX, XLSX, PNG, PDF, HTML, MD, CSV, JSON, XML files☆162Updated this week
- ragflow中的ocr 部分，非官方项目☆53Updated last year