SpursGoZmy / Table-LLaVA
Dataset and Code for our ACL 2024 paper: "Multimodal Table Understanding". We propose the first large-scale Multimodal IFT and Pre-Train Dataset for table understanding and develop a generalist tabular MLLM named Table-LLaVA.
☆178Updated 3 months ago
Alternatives and similar repositories for Table-LLaVA:
Users that are interested in Table-LLaVA are comparing it to the libraries listed below
- Document Artifical Intelligence☆138Updated last month
- [ACM'MM 2024 Oral] Official code for "OneChart: Purify the Chart Structural Extraction via One Auxiliary Token"☆213Updated last month
- ☆128Updated 11 months ago
- A Toolkit for Table-based Question Answering☆109Updated last year
- official code for "Fox: Focus Anywhere for Fine-grained Multi-page Document Understanding"☆135Updated 7 months ago
- TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarios☆170Updated 3 months ago
- 【ArXiv】PDF-Wukong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling☆108Updated 3 months ago
- ☆247Updated 5 months ago
- GOT的vLLM加速实现 并结合 MinerU 实现RAG中的pdf 解析☆40Updated 2 months ago
- Vary-tiny codebase upon LAVIS (for training from scratch)and a PDF image-text pairs data (about 600k including English/Chinese)☆76Updated 3 months ago
- ☆281Updated 2 weeks ago
- A curated list of recent and past chart understanding work based on our survey paper: From Pixels to Insights: A Survey on Automatic Char…☆177Updated 5 months ago
- Repo for Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agent☆205Updated this week
- A High-efficiency Open-source Toolkit for Table-to-Latex Task☆192Updated last month
- Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"☆208Updated 3 months ago
- ☆206Updated last year
- A Comprehensive Benchmark for Document Parsing and Evaluation☆199Updated this week
- ☆206Updated 8 months ago
- An open-source implementaion for fine-tuning Qwen2-VL series by Alibaba Cloud.☆167Updated this week
- [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs☆93Updated 3 weeks ago
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆328Updated 4 months ago
- RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness☆273Updated last month
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆257Updated 4 months ago
- We collect papers about "large language models (LLM) for table-related tasks", e.g., using LLM for Table QA task. “表格+LLM”相关论文整理☆331Updated 3 weeks ago
- ☆110Updated 2 months ago
- InstructDoc: A Dataset for Zero-Shot Generalization of Visual Document Understanding with Instructions (AAAI2024)☆155Updated 7 months ago
- ☆66Updated 4 months ago
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning☆236Updated last year
- A series of technical report on Slow Thinking with LLM☆297Updated last week
- LongQLoRA: Extent Context Length of LLMs Efficiently☆163Updated last year