OpenMatch / NeuScraperLinks
[ACL 2024] This is the code repo for our ACL’24 paper "Cleaner Pretraining Corpus Curation with Neural Web Scraping".
☆230Updated last year
Alternatives and similar repositories for NeuScraper
Users that are interested in NeuScraper are comparing it to the libraries listed below
Sorting:
- ☆67Updated last year
- A lightweight script for processing HTML page to markdown format with support for code blocks☆82Updated last year
- Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]☆88Updated last year
- This is the code repo for our paper "Enhancing Knowledge Integration and Utilization of Large Language Models via Constructivist Cognitio…☆110Updated 3 months ago
- Benchmark baseline for retrieval qa applications☆119Updated last year
- Deep Reasoning Translation (DRT) Project☆241Updated 5 months ago
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆241Updated last year
- Official repo for "Make Your LLM Fully Utilize the Context"☆263Updated last year
- Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.☆411Updated last year
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale☆265Updated 7 months ago
- [Preprint] Learning to Filter Context for Retrieval-Augmented Generaton☆196Updated last year
- [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement☆193Updated last year
- ☆320Updated last year
- ☆96Updated last year
- [ACL24] Official repo for "Synthesizing Text-to-SQL Data from Weak and Strong LLMs"☆68Updated last year
- Reformatted Alignment☆111Updated last year
- [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation☆311Updated last year
- Code implement reposity of Paper HiQA☆104Updated 11 months ago
- [ACL 2025] AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark☆165Updated 3 months ago
- Evaluation tools for Retrieval-augmented Generation (RAG) methods.☆170Updated last year
- This is a repository of RALM surveys containing a summary of state-of-the-art RAG and other technologies☆202Updated last year
- LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA☆518Updated last year
- 🚢 Data Toolkit for Sailor Language Models☆95Updated 11 months ago
- ☆147Updated last year
- [NeurlPS D&B 2024] Generative AI for Math: MathPile☆419Updated 10 months ago
- This repository presents the original implementation of LumberChunker: Long-Form Narrative Document Segmentation by André V. Duarte, João…☆89Updated last year
- [ICLR 2025] The official implementation of paper "ToolGen: Unified Tool Retrieval and Calling via Generation"☆172Updated 10 months ago
- This repository contains the paper list for the paper: Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reaso…☆367Updated 2 years ago
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆237Updated 4 months ago
- Open replication of DeepSeek R1 for text-to-graph extraction.☆99Updated last year