commoncrawl / cc-notebooksLinks
Various Jupyter notebooks about Common Crawl data
☆59Updated 6 months ago
Alternatives and similar repositories for cc-notebooks
Users that are interested in cc-notebooks are comparing it to the libraries listed below
Sorting:
- Tools to construct and process Common Crawl webgraphs☆99Updated this week
- Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.☆63Updated this week
- A News Article Collection Library☆22Updated 2 years ago
- Statistics of Common Crawl monthly archives mined from URL index files☆194Updated last week
- An example of graph embeddings for wikipedia page recommendations☆11Updated 4 years ago
- Fastlaw's purpose is to replace generic word embeddings for work on supervised machine learning NLP-tasks with legal texts.☆40Updated 6 years ago
- Awesome Orchest projects, both official and submitted by the community.☆25Updated 2 years ago
- ☆83Updated 2 years ago
- MirrorDataGenerator is a python tool that generates synthetic data based on user-specified causal relations among features in the data. I…☆24Updated 3 years ago
- 🖍️ Highlight text in documents☆109Updated 6 months ago
- Index Common Crawl archives in tabular format☆121Updated 2 months ago
- Search PDFs using Jina, DocArray and Jina Hub☆56Updated 3 years ago
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Updated last year
- ☆33Updated 2 years ago
- Semantic search through a vectorized Wikipedia (SentenceBERT) with the Weaviate vector search engine☆243Updated 2 years ago
- Aim-spaCy integration☆34Updated 2 years ago
- Streamlit demo app to demonstrate the features of transformers interpret with multiple models.☆25Updated 4 years ago
- nbdev docs lookup for a few libraries and python itself☆24Updated this week
- Topic modeling helpers using managed language models from Cohere. Name text clusters using large GPT models.☆223Updated 2 years ago
- Transforming textual descriptions into process models using deep learning☆15Updated 6 years ago
- Process Common Crawl data with Python and Spark☆442Updated this week
- An open interface to GDELT APIs☆58Updated last year
- API Client for paperswithcode.com☆184Updated last year
- Tutorial and template for a semantic search app powered by the Atlas Embedding Database, Langchain, OpenAI and FastAPI☆113Updated 2 years ago
- new skills taxonomy using TextKernel data☆35Updated 3 years ago
- Finds linguistic patterns effortlessly☆38Updated 2 years ago
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy mod…☆15Updated 2 years ago
- Code for constructing TLDR corpus from Reddit dataset☆26Updated 3 years ago
- Entity resolution, also known as Data Matching or Record linkage is the task of finding a data set that refer to the same or similar real…☆29Updated 6 months ago
- News API - fetch news from CommonCrawl, parse with NewsPlease, enrich with pre-trained machine-learning models, to structured searchable …☆28Updated 3 years ago