commoncrawl / cc-notebooksLinks
Various Jupyter notebooks about Common Crawl data
☆62Updated 2 months ago
Alternatives and similar repositories for cc-notebooks
Users that are interested in cc-notebooks are comparing it to the libraries listed below
Sorting:
- Tools to construct and process Common Crawl webgraphs☆105Updated last week
- Statistics of Common Crawl monthly archives mined from URL index files☆208Updated this week
- Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.☆66Updated last week
- ☆84Updated 2 years ago
- Process Common Crawl data with Python and Spark☆452Updated 2 weeks ago
- A News Article Collection Library☆22Updated 2 years ago
- Streamlit demo app to demonstrate the features of transformers interpret with multiple models.☆25Updated 4 years ago
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Updated last year
- Fastlaw's purpose is to replace generic word embeddings for work on supervised machine learning NLP-tasks with legal texts.☆40Updated 6 years ago
- Vespa application making an index of the CORD-19 dataset.☆40Updated 7 months ago
- Code for constructing TLDR corpus from Reddit dataset☆27Updated 4 years ago
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆89Updated last year
- Index Common Crawl archives in tabular format☆125Updated last month
- Transforming textual descriptions into process models using deep learning☆15Updated 6 years ago
- 🌸 Train floret vectors☆18Updated 2 years ago
- Scripts to load the GDELT data set into MongoDB☆14Updated 3 years ago
- Semantic search through a vectorized Wikipedia (SentenceBERT) with the Weaviate vector search engine☆245Updated 2 years ago
- Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)☆40Updated 4 years ago
- Healthsea is a spaCy pipeline for analyzing user reviews of supplementary products for their effects on health.☆92Updated 4 years ago
- ☆94Updated 3 years ago
- A Streamlit app for showing a TimelineJS about the history of Natural Language Processing☆29Updated 2 years ago
- ☆29Updated 2 years ago
- Expose a Top2Vec model with a REST API.☆92Updated 3 years ago
- Information extraction pipeline containing coreference resolution, named entity linking, and relationship extraction☆81Updated 4 years ago
- A dataset for pretraining language models targeted for legal tasks.☆141Updated 3 years ago
- Tutorial and template for a semantic search app powered by the Atlas Embedding Database, Langchain, OpenAI and FastAPI☆114Updated 2 years ago
- News API - fetch news from CommonCrawl, parse with NewsPlease, enrich with pre-trained machine-learning models, to structured searchable …☆30Updated 3 years ago
- The AI Knowledge Editor☆184Updated 3 years ago
- Mining Legal Arguments in Court Decisions - Data and software☆73Updated 2 years ago
- The Semantic Scholar Search Reranker☆109Updated 5 years ago