OpenMatch / NeuScraperLinks
[ACL 2024] This is the code repo for our ACL’24 paper "Cleaner Pretraining Corpus Curation with Neural Web Scraping".
☆231Updated last year
Alternatives and similar repositories for NeuScraper
Users that are interested in NeuScraper are comparing it to the libraries listed below
Sorting:
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆241Updated last year
- Official repo for "Make Your LLM Fully Utilize the Context"☆261Updated last year
- [Preprint] Learning to Filter Context for Retrieval-Augmented Generaton☆196Updated last year
- A lightweight script for processing HTML page to markdown format with support for code blocks☆82Updated last year
- ☆67Updated last year
- Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]☆88Updated last year
- This is the code repo for our paper "Enhancing Knowledge Integration and Utilization of Large Language Models via Constructivist Cognitio…☆111Updated 3 months ago
- This is a repository of RALM surveys containing a summary of state-of-the-art RAG and other technologies☆201Updated last year
- [NeurlPS D&B 2024] Generative AI for Math: MathPile☆419Updated 9 months ago
- Benchmark baseline for retrieval qa applications☆118Updated last year
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale☆264Updated 6 months ago
- Deep Reasoning Translation (DRT) Project☆240Updated 4 months ago
- Evaluation tools for Retrieval-augmented Generation (RAG) methods.☆168Updated last year
- Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24☆152Updated last year
- Dense X Retrieval: What Retrieval Granularity Should We Use?☆167Updated 2 years ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆126Updated 2 months ago
- This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"☆206Updated 2 weeks ago
- Code for KaLM-Embedding models☆110Updated 6 months ago
- [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation☆310Updated last year
- ☆162Updated last year
- [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement☆193Updated last year
- Reformatted Alignment☆111Updated last year
- 🚢 Data Toolkit for Sailor Language Models☆95Updated 11 months ago
- ☆320Updated last year
- TF-ID: Table/Figure IDentifier for academic papers☆245Updated last year
- ☆61Updated last year
- ☆96Updated last year
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆145Updated last year
- Source code of the paper: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering [F…☆68Updated last year
- [ACL 2025] AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark☆166Updated 3 months ago