jackfsuia / LLM-Data-Cleaner
用大模型批量处理数据，现支持各种大模型做OCR，支持通义千问, 月之暗面, 百度飞桨OCR, OpenAI 和LLAVA。Use LLM to generate or clean data for academic use. Support OCR with qwen, moonshot, PaddleOCR, OpenAI, Llava.
☆13Updated 7 months ago
Alternatives and similar repositories for LLM-Data-Cleaner:
Users that are interested in LLM-Data-Cleaner are comparing it to the libraries listed below
- ☆17Updated 9 months ago
- A mini assistant to help you read paper quickly☆39Updated 2 weeks ago
- 训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。☆54Updated 7 months ago
- 使用langchain进行任务规划，构建子任务的会话场景资源，通过MCTS任务执行器，来让每个子任务通 过在上下文中资源，通过自身反思探索来获取自身对问题的最优答案；这种方式依赖模型的对齐偏好，我们在每种偏好上设计了一个工程框架，来完成自我对不同答案的奖励进行采样策略☆29Updated this week
- 😜 表情包视觉数据集，使用glm-4v、step-1v的图像解析能力标注。☆119Updated 11 months ago
- Qwen-WisdomVast is a large model trained on 1 million high-quality Chinese multi-turn SFT data, 200,000 English multi-turn SFT data, and …☆18Updated last year
- Generate dialog data from documents using LLM like ChatGLM2 or ChatGPT;利用ChatGLM2,ChatGPT等大模型根据文档生成对话数据集☆157Updated last year
- Built on the robust XTuner backend framework, XTuner Chat GUI offers a user-friendly platform for quick and efficient local model inferen…☆13Updated last year
- SearchGPT: Building a quick conversation-based search engine with LLMs.☆45Updated 3 months ago
- Imitate OpenAI with Local Models☆88Updated 7 months ago
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆50Updated this week
- 纯c++的全平台llm加速库，支持python调用，支持chatglm-6B, llama, baichuan, moss基座，x86 / ARM☆9Updated 2 months ago
- NLP 项目记录档案☆53Updated last month
- 介绍docker、docker compose的使用。☆20Updated 7 months ago
- 收集优质的角色扮演聊天数据 | Collection of roleplay conversations of high quality☆11Updated 4 months ago
- 我们是第一个完全可商用的角色大模型。☆39Updated 8 months ago
- ☆78Updated 11 months ago
- 利用多Agent对区域进行地址提取☆27Updated 2 weeks ago
- ☆23Updated 5 months ago
- 视觉信息抽取任务中，使用OCR识别结果规范多模态大模型的回答☆28Updated 3 months ago
- ☆26Updated 6 months ago
- Just for debug☆56Updated last year
- XVERSE-65B: A multilingual large language model developed by XVERSE Technology Inc.☆139Updated last year
- An OpenAI API-compatible middleware for Qwen OpenAI API, implementing (stream) tool calling functionality☆8Updated 8 months ago
- 一起来养一只拥有专属记忆的AI猫猫吧！☆10Updated 5 months ago
- zero零训练llm调参☆31Updated last year
- TianGong-AI-Unstructure☆63Updated last week
- ☆36Updated 6 months ago
- 集成了LLM与SDXL的AIGC应用程序☆27Updated last year
- 基于Llama3，通过进一步CPT，SFT，ORPO得到的中文版Llama3☆17Updated 11 months ago