Various Jupyter notebooks about Common Crawl data
☆69Sep 8, 2026Updated last month
Alternatives and similar repositories for cc-notebooks
Users that are interested in cc-notebooks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Index Common Crawl archives in tabular format☆132Oct 22, 2026Updated last week
- Process Common Crawl data with Python and Spark☆459Sep 17, 2026Updated last month
- Statistics of Common Crawl monthly archives mined from URL index files☆233Oct 22, 2026Updated last week
- ☆26Mar 20, 2024Updated 2 years ago
- Tools to construct and process Common Crawl webgraphs☆118Oct 21, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Scientific articles using or citing Common Crawl data☆31Oct 26, 2026Updated last week
- News crawling with StormCrawler - stores content as WARC☆382Updated this week
- React-Autosuggest for Plotly Dash with Elasticsearch integration.☆12Dec 3, 2022Updated 3 years ago
- A simple package allowing to use WebGraph data in Python (via the Jython interpreter).☆20Oct 21, 2020Updated 6 years ago
- A robust web archive analytics toolkit☆152Updated this week
- 🕸 A simple way to extract data from Common Crawl☆35Feb 24, 2020Updated 6 years ago
- A polite and user-friendly downloader for Common Crawl data☆98Oct 26, 2026Updated last week
- Scraper of ResetEra threads and posts to get them into a format suitable for feeding them into GPT-2.☆15Jun 20, 2019Updated 7 years ago
- Curated list of awesome datasets for various table understanding tasks☆20Sep 5, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Python function for condensing JSON using replacement strings☆13Aug 3, 2026Updated 2 months ago
- Various examples of notebooks for working with web archives with the Archives Unleashed Toolkit, and derivatives generated by the Archive…☆27Dec 5, 2022Updated 3 years ago
- A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine☆220Oct 16, 2026Updated 2 weeks ago
- Streaming WARC/ARC library for fast web archive IO☆483Updated this week
- A collection of models for TensorFlow Go☆12May 29, 2022Updated 4 years ago
- Analyse des Pegida facebook Korpus☆10Jan 31, 2015Updated 11 years ago
- AWS Lambda shell commands in $PATH available to runtime subprocesses☆12Sep 1, 2021Updated 5 years ago
- ☆12Oct 29, 2019Updated 7 years ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆34Jan 23, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Leverage modern open-source tools to create better web scraping workflows.☆32Feb 29, 2024Updated 2 years ago
- A Datasette plugin for making data visualizations with Observable Plot☆29Sep 17, 2026Updated last month
- T5 model optimized with FlexAttention☆14Sep 30, 2024Updated 2 years ago
- Measuring the Evolution of a Scientific Field through Citation Frames☆65Oct 5, 2018Updated 8 years ago
- Index URLs in Common Crawl☆197Sep 19, 2017Updated 9 years ago
- Go API-first and Database-first demo app with OpenAPI v3 and sqlc/xo codegen, OIDC auth, React TypeScript frontend, end to end tracing wi…☆11Feb 9, 2026Updated 8 months ago
- Package with functions to handle network data and run Infomap, inspired by ecological networks☆28Apr 24, 2026Updated 6 months ago
- This repo is for the Linkedin Learning course: Controlling ChatGPT with Custom Instructions or API System Messages☆18Nov 19, 2025Updated 11 months ago
- A News Article Collection Library☆22Mar 31, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Benchmark dataset for the evaluation of scientific article representations on the task of citation recommendation across various scientif…☆12Oct 21, 2022Updated 4 years ago
- A plugin that allows you to use JSX as a templating language for Eleventy☆12Nov 2, 2020Updated 6 years ago
- Start project for Netlify Comments☆13May 26, 2020Updated 6 years ago
- LinkRun - Data Engineering project done in 3 weeks during the Insight fellowship☆38Apr 2, 2020Updated 6 years ago
- Applying Reinforcement Learning from Human Feedback to language models to teach them to write short story responses to writing prompts.☆13May 5, 2022Updated 4 years ago
- ☆12Jun 24, 2021Updated 5 years ago
- A Test Collection of Computer Science Papers for Faceted Query by Example☆26Nov 28, 2021Updated 4 years ago