Alternatives and similar repositories for NeuScraper

Users that are interested in NeuScraper are comparing it to the libraries listed below

• SivilTaram / code-html-to-markdown
  A lightweight script for processing HTML page to markdown format with support for code blocks
  ☆79Updated last year
• OpenMatch / ActiveRAG
  This is the code repo for our paper "Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents".
  ☆107Updated 9 months ago
• TIGER-AI-Lab / LongRAG
  Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".
  ☆235Updated 11 months ago
• zorazrw / filco
  [Preprint] Learning to Filter Context for Retrieval-Augmented Generaton
  ☆193Updated last year
• cxcscmu / RAGViz
  Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]
  ☆86Updated 6 months ago
• microsoft / FILM
  Official repo for "Make Your LLM Fully Utilize the Context"
  ☆253Updated last year
• GAIR-NLP / ProX
  [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale
  ☆255Updated 3 weeks ago
• read-agent / read-agent.github.io
  ☆64Updated last year
• myeon9h / PlanRAG
  Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24
  ☆142Updated last year
• THUDM / LongCite
  LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA
  ☆503Updated 7 months ago
• AIR-Bench / AIR-Bench
  [ACL 2025] AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆150Updated last week
• krystalan / DRT
  Deep Reasoning Translation (DRT) Project
  ☆227Updated 2 months ago
• joaodsmarques / LumberChunker
  This repository presents the original implementation of LumberChunker: Long-Form Narrative Document Segmentation by André V. Duarte, João…
  ☆70Updated 10 months ago
• myscale / Retrieval-QA-Benchmark
  Benchmark baseline for retrieval qa applications
  ☆115Updated last year
• jakespringer / echo-embeddings
  ☆152Updated last year
• SqueezeAILab / LLM2LLM
  [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
  ☆187Updated last year
• DunZhang / Stella
  ☆62Updated last year
• HITsz-TMG / KaLM-Embedding
  Code for KaLM-Embedding models
  ☆86Updated last month
• liyucheng09 / Selective_Context
  Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.
  ☆390Updated last year
• hyintell / RetrievalQA
  Source code of the paper: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering [F…
  ☆67Updated last year
• fate-ubw / RAGLAB
  [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation
  ☆302Updated 9 months ago
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆94Updated 5 months ago
• 2471023025 / RALM_Survey
  This is a repository of RALM surveys containing a summary of state-of-the-art RAG and other technologies
  ☆200Updated last year
• gomate-community / rageval
  Evaluation tools for Retrieval-augmented Generation (RAG) methods.
  ☆162Updated 8 months ago
• chentong0 / factoid-wiki
  Dense X Retrieval: What Retrieval Granularity Should We Use?
  ☆159Updated last year
• GAIR-NLP / MathPile
  [NeurlPS D&B 2024] Generative AI for Math: MathPile
  ☆415Updated 4 months ago
• DaoD / INTERS
  This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"
  ☆204Updated 7 months ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆114Updated 3 weeks ago
• ai8hyf / TF-ID
  TF-ID: Table/Figure IDentifier for academic papers
  ☆238Updated last year
• Bui1dMySea / MemLong
  ☆94Updated 8 months ago