commoncrawl / cc-notebooksLinks
Various Jupyter notebooks about Common Crawl data
☆61Updated last month
Alternatives and similar repositories for cc-notebooks
Users that are interested in cc-notebooks are comparing it to the libraries listed below
Sorting:
- Tools to construct and process Common Crawl webgraphs☆104Updated 3 weeks ago
- Statistics of Common Crawl monthly archives mined from URL index files☆208Updated this week
- Process Common Crawl data with Python and Spark☆452Updated this week
- 🌸 Train floret vectors☆18Updated 2 years ago
- Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.☆65Updated this week
- An example of graph embeddings for wikipedia page recommendations☆11Updated 4 years ago
- Index Common Crawl archives in tabular format☆124Updated 3 weeks ago
- Fastlaw's purpose is to replace generic word embeddings for work on supervised machine learning NLP-tasks with legal texts.☆40Updated 6 years ago
- A News Article Collection Library☆22Updated 2 years ago
- Streamlit demo app to demonstrate the features of transformers interpret with multiple models.☆25Updated 4 years ago
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆67Updated 2 years ago
- Transforming textual descriptions into process models using deep learning☆15Updated 6 years ago
- Semantic search through a vectorized Wikipedia (SentenceBERT) with the Weaviate vector search engine☆245Updated 2 years ago
- A conda-smithy repository for spacy.☆14Updated 2 months ago
- FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction☆24Updated 3 years ago
- A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine☆196Updated this week
- Intelligence Task Ontology (ITO)☆75Updated 3 years ago
- ☆32Updated 2 years ago
- Vespa application making an index of the CORD-19 dataset.☆40Updated 6 months ago
- YT_subtitles - extracts subtitles from YouTube videos to raw text for Language Model training☆45Updated 5 years ago
- Code for constructing TLDR corpus from Reddit dataset☆27Updated 4 years ago
- Topic modeling helpers using managed language models from Cohere. Name text clusters using large GPT models.☆222Updated 3 years ago
- The AI Knowledge Editor☆184Updated 3 years ago
- XAI based human-in-the-loop framework for automatic rule-learning.☆49Updated last year
- API Client for paperswithcode.com☆189Updated last year
- Information extraction pipeline containing coreference resolution, named entity linking, and relationship extraction☆80Updated 4 years ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆36Updated 2 years ago
- 💫 SpaCy wrapper for ConceptNet 💫☆95Updated 2 weeks ago
- ☆84Updated 2 years ago
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Updated last year