Alternatives and similar repositories for wiki_dump

Users that are interested in wiki_dump are comparing it to the libraries listed below

• facebookresearch / side
  The AI Knowledge Editor
  ☆184Updated 3 years ago
• bigscience-workshop / lam
  Libraries, Archives and Museums (LAM)
  ☆88Updated 3 years ago
• commoncrawl / web-languages
  Crowd-sourced lists of urls to help Common Crawl crawl under-resourced languages. See https://github.com/commoncrawl/web-languages-code/ …
  ☆69Updated last month
• richardpaulhudson / coreferee
  Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further lang…
  ☆134Updated last year
• MaxHalford / orc
  🧌 Parsing structured information from OCR outputs
  ☆20Updated 2 years ago
• explosion / spacy-vscode
  spaCy extension for Visual Studio Code
  ☆31Updated 11 months ago
• wellcometrust / grants_tagger
  Tag grants with MeSH and other tags
  ☆17Updated 2 years ago
• bbc / citron
  Citron is an experimental quote extraction system created by BBC R&D
  ☆36Updated 4 years ago
• explosion / healthsea
  Healthsea is a spaCy pipeline for analyzing user reviews of supplementary products for their effects on health.
  ☆92Updated 4 years ago
• Mithileysh / Email-Datasets
  Email Datasets can be found here
  ☆80Updated last month
• psmedia / Books3Info
  Data and information related to the Books3 dataset included as part of The Pile, and used to train Meta's LLaMA among others
  ☆35Updated 9 months ago
• richardpaulhudson / holmes-extractor
  Information extraction from English and German texts based on predicate logic
  ☆141Updated 2 years ago
• koaning / arxiv-frontpage
  My personal frontpage app
  ☆108Updated last week
• facebookresearch / personal-timeline
  A public release of TimelineBuilder for building personal digital data timelines.
  ☆370Updated last year
• cdisc-org / usdm
  ☆12Updated 3 weeks ago
• mixedbread-ai / maxsim-cpu
  ☆51Updated 7 months ago
• harvard-lil / capstone
  CAP database scripts.
  ☆192Updated last year
• r-three / common-pile
  Code for collecting, processing, and preparing datasets for the Common Pile
  ☆249Updated 5 months ago
• pgcorpus / gutenberg
  Pipeline to generate the Standardized Project Gutenberg Corpus
  ☆208Updated 2 years ago
• rungalileo / dataquality
  Python SDK for Galileo's NLP and CV Studio.
  ☆17Updated last week
• explosion / thinc-apple-ops
  🍏 Make Thinc faster on macOS by calling into Apple's native Accelerate library
  ☆103Updated 7 months ago
• theirstory / gliner-spacy
  A spaCy wrapper for GliNER
  ☆129Updated last year
• commoncrawl / cc-crawl-statistics
  Statistics of Common Crawl monthly archives mined from URL index files
  ☆208Updated last week
• facebookresearch / Sphere
  Web-scale retrieval for knowledge-intensive NLP
  ☆554Updated 3 years ago
• delvinso / covid19_unique_tweets
  An on-going dataset consisting of hashtags, n-gram counts and other misc NLP things for covid-19 analysis, stemming from over 100 000 000…
  ☆59Updated 3 years ago
• freelawproject / eyecite
  Find legal citations in any block of text
  ☆208Updated 4 months ago
• bumble-tech / buzzwords
  GPU-Powered Topic Modelling
  ☆70Updated 3 years ago
• commoncrawl / cc-webgraph
  Tools to construct and process Common Crawl webgraphs
  ☆105Updated last week
• bamman-group / gpt4-books
  Code and data to support "Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4"
  ☆69Updated 2 years ago
• adbar / courlan
  Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters
  ☆158Updated last month