Alternatives and similar repositories for cc-webgraph

Users that are interested in cc-webgraph are comparing it to the libraries listed below

• commoncrawl / cc-notebooks
  Various Jupyter notebooks about Common Crawl data
  ☆54Updated 2 months ago
• commoncrawl / cc-crawl-statistics
  Statistics of Common Crawl monthly archives mined from URL index files
  ☆183Updated 3 weeks ago
• commoncrawl / cc-index-table
  Index Common Crawl archives in tabular format
  ☆122Updated last month
• KGCP / MEL-TNNT
  Metadata Extractor & Loader (MEL) ■ The NLP-NER Toolkit (TNNT)
  ☆23Updated 2 years ago
• cocrawler / cdx_toolkit
  A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine
  ☆177Updated 5 months ago
• kermitt2 / article_dataset_builder
  Open Access PDF harvester, metadata aggregator and full-text ingester
  ☆60Updated last year
• commoncrawl / cc-index-server
  Common Crawl Index Server
  ☆68Updated 3 months ago
• webis-de / webis-tldr-17-corpus
  Code for constructing TLDR corpus from Reddit dataset
  ☆25Updated 3 years ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 7 years ago
• simonw / llm-cluster
  LLM plugin for clustering embeddings
  ☆76Updated last year
• datacommonsorg / api-python
  Python client library to access Data Commons
  ☆73Updated 2 weeks ago
• JoelNiklaus / LegalDatasets
  This repository serves as a collection of scrapers procuring and structuring various legal datasets
  ☆17Updated 2 years ago
• archivesunleashed / notebooks
  Various examples of notebooks for working with web archives with the Archives Unleashed Toolkit, and derivatives generated by the Archive…
  ☆26Updated 2 years ago
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 5 years ago
• alea-institute / nupunkt
  Next-generation Punkt sentence boundary detection with zero dependencies
  ☆17Updated 2 months ago
• explosion / wikid
  Generate a SQLite database from Wikipedia & Wikidata dumps.
  ☆35Updated last year
• maastrichtlawtech / case-law-explorer
  ☁️ A network analysis software platform for analyzing Dutch and European court decisions.
  ☆18Updated 3 weeks ago
• mommi84 / rdf-qa
  Explainable complex question answering over RDF files via Llama Index.
  ☆31Updated 2 years ago
• scales-okn / PACER-tools
  ☆25Updated last month
• commoncrawl / web-languages
  Crowd-sourced lists of urls to help Common Crawl crawl under-resourced languages. See https://github.com/commoncrawl/web-languages-code/ …
  ☆45Updated this week
• explosion / spacy-curated-transformers
  spaCy entry points for Curated Transformers
  ☆31Updated 3 weeks ago
• OpenLinkSoftware / OSDS_extension
  The OpenLink Structured Data Sniffer (OSDS) is Web Extensions compliant Browser Extension for Chrome, Firefox and Opera browsers that det…
  ☆46Updated 2 months ago
• harvard-lil / h2o
  H2O is a web app for creating and reading open educational resources, primarily in the legal field
  ☆38Updated last month
• conda-forge / spacy-feedstock
  A conda-smithy repository for spacy.
  ☆14Updated last month
• urchade / GraphER
  GraphER: A Structure-aware Text-to-Graph Model for Entity and Relation Extraction
  ☆74Updated 10 months ago
• adbar / htmldate
  Fast and robust date extraction from web pages, with Python or on the command-line
  ☆130Updated 5 months ago
• explosion / spacy-huggingface-pipelines
  💥 Use Hugging Face text and token classification pipelines directly in spaCy
  ☆63Updated last year
• yago-naga / yago-4.5
  The YAGO version that integrates the Wikidata taxonomy
  ☆46Updated 3 weeks ago
• Senzing / awesome
  Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.
  ☆59Updated 2 weeks ago
• athalhammer / danker
  Compute PageRank on >3 billion Wikipedia links on off-the-shelf hardware.
  ☆60Updated 7 months ago