commoncrawl / cc-notebooksLinks
Various Jupyter notebooks about Common Crawl data
☆55Updated 4 months ago
Alternatives and similar repositories for cc-notebooks
Users that are interested in cc-notebooks are comparing it to the libraries listed below
Sorting:
- Tools to construct and process Common Crawl webgraphs☆93Updated 3 weeks ago
- Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.☆61Updated last week
- A News Article Collection Library☆22Updated 2 years ago
- Statistics of Common Crawl monthly archives mined from URL index files☆189Updated last week
- This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around t…☆33Updated 2 years ago
- nbdev docs lookup for a few libraries and python itself☆24Updated this week
- Process Common Crawl data with Python and Spark☆442Updated 2 months ago
- 🌸 Train floret vectors☆18Updated 2 years ago
- Scripts to load the GDELT data set into MongoDB☆14Updated 2 years ago
- Fastlaw's purpose is to replace generic word embeddings for work on supervised machine learning NLP-tasks with legal texts.☆38Updated 6 years ago
- A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine☆181Updated 7 months ago
- News API - fetch news from CommonCrawl, parse with NewsPlease, enrich with pre-trained machine-learning models, to structured searchable …☆29Updated 2 years ago
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Updated last year
- Aim-spaCy integration☆34Updated 2 years ago
- Scraping Assisted by Learning☆35Updated 2 weeks ago
- Data pipeline for streaming, processing, and analyzing the GDELT global events dataset.☆10Updated 8 years ago
- ☆81Updated 2 years ago
- Index Common Crawl archives in tabular format☆124Updated 3 weeks ago
- PyPi module for Graphlet AI Knowledge Graph Factory☆29Updated 2 years ago
- Awesome Orchest projects, both official and submitted by the community.☆25Updated last year
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆66Updated 2 years ago
- Intelligence Task Ontology (ITO)☆74Updated 2 years ago
- Tutorial and template for a semantic search app powered by the Atlas Embedding Database, Langchain, OpenAI and FastAPI☆115Updated last year
- API Client for paperswithcode.com☆183Updated last year
- ☆23Updated last year
- A conda-smithy repository for spacy.☆14Updated last month
- Python based Wikidata framework for easy dataframe extraction☆45Updated last year
- Solve Geometric & Graph Problems with Large Language Models☆31Updated 2 years ago
- 🖍️ Highlight text in documents☆108Updated 4 months ago
- Deployment of pywb as a CommonCrawl Index Server☆21Updated 7 years ago