Alternatives and similar repositories for NeuScraper

Users that are interested in NeuScraper are comparing it to the libraries listed below

• SivilTaram / code-html-to-markdown
  A lightweight script for processing HTML page to markdown format with support for code blocks
  ☆79Updated last year
• IAAR-Shanghai / Meta-Chunking
  Meta-Chunking: Learning Efficient Text Segmentation via Logical Perception
  ☆195Updated 2 weeks ago
• chentong0 / factoid-wiki
  Dense X Retrieval: What Retrieval Granularity Should We Use?
  ☆157Updated last year
• cxcscmu / RAGViz
  Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]
  ☆84Updated 5 months ago
• GAIR-NLP / ProX
  [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale
  ☆251Updated 3 weeks ago
• krystalan / DRT
  Deep Reasoning Translation (DRT) Project
  ☆224Updated last month
• thu-coai / CritiqueLLM
  ☆142Updated 11 months ago
• HITsz-TMG / KaLM-Embedding
  Code for KaLM-Embedding models
  ☆78Updated 3 months ago
• read-agent / read-agent.github.io
  ☆58Updated 11 months ago
• OpenMatch / ActiveRAG
  This is the code repo for our paper "Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents".
  ☆107Updated 8 months ago
• TIGER-AI-Lab / LongRAG
  Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".
  ☆235Updated 10 months ago
• zorazrw / filco
  [Preprint] Learning to Filter Context for Retrieval-Augmented Generaton
  ☆193Updated last year
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆137Updated 7 months ago
• Reason-Wang / ToolGen
  [ICLR 2025] The official implementation of paper "ToolGen: Unified Tool Retrieval and Calling via Generation"
  ☆145Updated 3 months ago
• THUDM / LongCite
  LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA
  ☆496Updated 5 months ago
• OpenBMB / Eurus
  ☆318Updated 9 months ago
• myeon9h / PlanRAG
  Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24
  ☆139Updated last year
• fate-ubw / RAGLAB
  [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation
  ☆301Updated 8 months ago
• myscale / Retrieval-QA-Benchmark
  Benchmark baseline for retrieval qa applications
  ☆115Updated last year
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆92Updated 4 months ago
• onesuper / HuggingFace-Datasets-Text-Quality-Analysis
  Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…
  ☆53Updated last year
• jakespringer / echo-embeddings
  ☆150Updated last year
• Ingvarstep / open-r1-text2graph
  Open replication of DeepSeek R1 for text-to-graph extraction.
  ☆94Updated 4 months ago
• gomate-community / rageval
  Evaluation tools for Retrieval-augmented Generation (RAG) methods.
  ☆157Updated 7 months ago
• night-chen / ToolQA
  ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …
  ☆268Updated last year
• castorini / rank_llm
  RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
  ☆472Updated this week
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆244Updated 7 months ago
• joaodsmarques / LumberChunker
  This repository presents the original implementation of LumberChunker: Long-Form Narrative Document Segmentation by André V. Duarte, João…
  ☆69Updated 8 months ago
• OpenBMB / RAGEval
  ☆178Updated 2 months ago
• GAIR-NLP / MathPile
  [NeurlPS D&B 2024] Generative AI for Math: MathPile
  ☆414Updated 2 months ago