adoresever / Pretuning
A tool for creating pre-training datasets for language models, supporting one-click batch processing for both text and image datasets. 一个专为语言模型预训练设计的数据集制作工具,支持文本和图像数据集的一键式批量处理。
☆28Updated 2 months ago
Alternatives and similar repositories for Pretuning:
Users that are interested in Pretuning are comparing it to the libraries listed below
- GraphRAG-Ollama-UI + GraphRAG4OpenWebUI 融合版(有gradio webui配置生成RAG索引,有fastapi提供RAG API服务)☆101Updated 6 months ago
- LightRAG与GraphRAG在索引构建、检索测试中的耗时、模型请求次数、Token消耗金额、检索质量等方面进行对比☆58Updated 3 months ago
- 添加🚀流式 Web 服务到 GraphRAG,兼容 OpenAI SDK,支持可访问的实体链接🔗,支持建议问题,兼容本地嵌入模型,修复诸多问题。Add streaming web server to GraphRAG, compatible with OpenAI SD…☆240Updated 2 months ago
- 支持中文🇨🇳🇨🇳🇨🇳 的 microsoft/graphrag☆38Updated last month
- 文本语料转训练集工具,txt转dataset☆89Updated 10 months ago
- generate ppt with llm☆83Updated last year
- Scenario-based large model testing toolbox☆23Updated 7 months ago
- GraphRAG Server☆68Updated last month
- ☆210Updated 2 months ago
- GraphRAG的应用实例,项目特点在于提供了替换OpenAI模型的方法,并通过修改原有提示和切分文档的方法,提高了GraphRAG处理中文内容的能力。☆125Updated 4 months ago
- 利用免费的大模型api来结合你的私域数据来生成sft训练数据(妥妥白嫖)支持llamafactory等工具的训练数据格式synthetic data☆150Updated 3 months ago
- FlexRAG: A RAG Framework for Information Retrieval and Generation.☆133Updated 2 weeks ago
- KAG开源框架介绍及使用KAG实现知识增强生成应用(产品模式测试、开发者模式测试),KAG是OpenSPG发布v0.5版本中推出的知识增强生成(KAG)的专业领域知识服务框架,旨在充分利用知识图谱和向量检索的优势,增强大型语言模型和知识图谱,以解决 RAG 挑战☆65Updated last month
- "LightRAG: Simple and Fast Retrieval-Augmented Generation"☆46Updated 4 months ago
- ☆52Updated this week
- 这个仓库主要用于记录以MetaGPT为基础的Agent开发理论学习记录☆23Updated 9 months ago
- GOT-OCR的GUI版本,提供OCR、导出PDF、批处理等功能,但不提供训练功能☆153Updated this week
- 自动批量上传并解析文档至 RagFlow 知识库,省去手动操作,提升效率。☆175Updated last month
- gpt_server是一个用于生产级部署LLMs或Embedding的开源框架。☆158Updated this week
- A low-code data flow tool that allows for convenient use of LLM and HuggingFace models, with some features considered as a low-code versi…☆289Updated 2 weeks ago
- ☆59Updated 4 months ago
- E2M API, converting everything to markdown (LLM-friendly Format).☆134Updated 3 months ago
- A LLM RAG system runs on your laptop. 大模型检索增强生成系统,可以轻松部署在笔记本电脑上,实现本地知识库智能问答。☆189Updated last month
- ☆85Updated last week
- ☆46Updated 3 weeks ago
- Repo for for paper "AgentRE: An Agent-Based Framework for Navigating Complex Information Landscapes in Relation Extraction".☆62Updated 7 months ago
- Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 轻松构建智能、具备反思能力、可协作的多模态AI Agent。☆138Updated this week