commoncrawl / cc-notebooksLinks
Various Jupyter notebooks about Common Crawl data
☆57Updated 5 months ago
Alternatives and similar repositories for cc-notebooks
Users that are interested in cc-notebooks are comparing it to the libraries listed below
Sorting:
- Tools to construct and process Common Crawl webgraphs☆96Updated 2 weeks ago
- Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.☆62Updated this week
- Statistics of Common Crawl monthly archives mined from URL index files☆192Updated last week
- This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around t…☆33Updated 2 years ago
- Expose a Top2Vec model with a REST API.☆92Updated 2 years ago
- Code for constructing TLDR corpus from Reddit dataset☆26Updated 3 years ago
- ☆82Updated 2 years ago
- News API - fetch news from CommonCrawl, parse with NewsPlease, enrich with pre-trained machine-learning models, to structured searchable …☆29Updated 2 years ago
- A News Article Collection Library☆22Updated 2 years ago
- Healthsea is a spaCy pipeline for analyzing user reviews of supplementary products for their effects on health.☆92Updated 3 years ago
- Process Common Crawl data with Python and Spark☆440Updated 2 weeks ago
- Tutorial and template for a semantic search app powered by the Atlas Embedding Database, Langchain, OpenAI and FastAPI☆114Updated 2 years ago
- Aim-spaCy integration☆34Updated 2 years ago
- Information extraction pipeline containing coreference resolution, named entity linking, and relationship extraction☆81Updated 4 years ago
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆66Updated 2 years ago
- 🌸 Train floret vectors☆18Updated 2 years ago
- Scripts to load the GDELT data set into MongoDB☆14Updated 2 years ago
- Semantic search through a vectorized Wikipedia (SentenceBERT) with the Weaviate vector search engine☆242Updated 2 years ago
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Updated last year
- Document level Attitude and Relation Extraction toolkit (AREkit) for sampling and processing large text collections with ML and for ML☆63Updated 7 months ago
- Streamlit demo app to demonstrate the features of transformers interpret with multiple models.☆25Updated 4 years ago
- Graph databases, Knowledge Graphs, SPARQ☆80Updated 4 years ago
- 🖍️ Highlight text in documents☆109Updated 4 months ago
- Socrates is a thin wrapper around an early-stage [AllenNLP](https://allennlp.org/) model that enables machine reading comprehension (MRC)…☆14Updated 4 years ago
- ☆29Updated 2 years ago
- nbdev docs lookup for a few libraries and python itself☆24Updated last week
- Query and visualize knowledge graphs☆60Updated 5 months ago
- ☆55Updated last year
- A dataset for pretraining language models targeted for legal tasks.☆139Updated 3 years ago
- Code for the paper: "Large Language Models as Corporate Lobbyists" (2023).☆171Updated 2 years ago