Alternatives and similar repositories for NeuScraper

Users that are interested in NeuScraper are comparing it to the libraries listed below

• SivilTaram / code-html-to-markdown
  A lightweight script for processing HTML page to markdown format with support for code blocks
  ☆79Updated last year
• GAIR-NLP / ProX
  [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale
  ☆248Updated 3 weeks ago
• zorazrw / filco
  [Preprint] Learning to Filter Context for Retrieval-Augmented Generaton
  ☆192Updated last year
• OpenMatch / ActiveRAG
  This is the code repo for our paper "Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents".
  ☆106Updated 7 months ago
• fate-ubw / RAGLAB
  [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation
  ☆299Updated 7 months ago
• read-agent / read-agent.github.io
  ☆51Updated 10 months ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆135Updated 6 months ago
• TIGER-AI-Lab / LongRAG
  Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".
  ☆231Updated 9 months ago
• chentong0 / factoid-wiki
  Dense X Retrieval: What Retrieval Granularity Should We Use?
  ☆157Updated last year
• GAIR-NLP / MathPile
  [NeurlPS D&B 2024] Generative AI for Math: MathPile
  ☆412Updated 2 months ago
• SqueezeAILab / LLM2LLM
  [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
  ☆183Updated last year
• OpenBMB / RAGEval
  ☆171Updated 2 months ago
• Ingvarstep / open-r1-text2graph
  Open replication of DeepSeek R1 for text-to-graph extraction.
  ☆94Updated 4 months ago
• krystalan / DRT
  Deep Reasoning Translation via Reinforcement Learning (arXiv preprint 2025); DRT: Deep Reasoning Translation via Long Chain-of-Thought (a…
  ☆224Updated last week
• IAAR-Shanghai / Meta-Chunking
  Meta-Chunking: Learning Efficient Text Segmentation via Logical Perception
  ☆171Updated this week
• ninehills / langeval
  Evaluation for AI apps and agent
  ☆41Updated last year
• thu-coai / CritiqueLLM
  ☆142Updated 11 months ago
• cxcscmu / RAGViz
  Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]
  ☆83Updated 4 months ago
• AIR-Bench / AIR-Bench
  AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆142Updated 5 months ago
• HITsz-TMG / KaLM-Embedding
  Code for KaLM-Embedding models
  ☆78Updated 2 months ago
• YHPeter / Awesome-RAG-Evaluation
  The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.
  ☆158Updated last month
• Reason-Wang / ToolGen
  [ICLR 2025] The official implementation of paper "ToolGen: Unified Tool Retrieval and Calling via Generation"
  ☆142Updated 2 months ago
• LightChen233 / Awesome-LLM-for-NLP
  ☆99Updated last year
• wey-gu / grpo-graph-extraction
  Qwen GRPO Graph Extraction RL Finetune
  ☆49Updated 2 months ago
• 2471023025 / RALM_Survey
  This is a repository of RALM surveys containing a summary of state-of-the-art RAG and other technologies
  ☆202Updated 11 months ago
• DaoD / INTERS
  This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"
  ☆203Updated 5 months ago
• liyucheng09 / Selective_Context
  Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.
  ☆383Updated last year
• Bui1dMySea / MemLong
  ☆94Updated 6 months ago
• shizhediao / Post-Training-Data-Flywheel
  We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.
  ☆55Updated 8 months ago
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆104Updated 2 months ago