Various Jupyter notebooks about Common Crawl data
☆66Jul 3, 2026Updated 3 weeks ago
Alternatives and similar repositories for cc-notebooks
Users that are interested in cc-notebooks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Process Common Crawl data with Python and Spark☆457Mar 26, 2026Updated 3 months ago
- Statistics of Common Crawl monthly archives mined from URL index files☆226Updated this week
- Tools to construct and process Common Crawl webgraphs☆111Updated this week
- News crawling with StormCrawler - stores content as WARC☆375Updated this week
- Deployment of pywb as a CommonCrawl Index Server☆22Oct 6, 2017Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Scraper of ResetEra threads and posts to get them into a format suitable for feeding them into GPT-2.☆15Jun 20, 2019Updated 7 years ago
- LiT (Zero-Shot Transfer with Locked-image text Tuning) image and text encoder models, working in the browser☆11May 16, 2022Updated 4 years ago
- ☆10Apr 10, 2014Updated 12 years ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆33Jan 23, 2025Updated last year
- Leverage modern open-source tools to create better web scraping workflows.☆31Feb 29, 2024Updated 2 years ago
- TypeScript library, MCP, and agent-friendly CLI for the BuiltWith API.☆23Jul 8, 2026Updated 2 weeks ago
- Single server/laptop grade file-observatory☆10Mar 30, 2023Updated 3 years ago
- ☆10May 17, 2022Updated 4 years ago
- NOT AN ACTIVE PROJECT -- Check readme for data sources☆36May 28, 2017Updated 9 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- CascadER: Cross-Modal Cascading for Knowledge Graph Link Prediction (arXiv 22)☆13Jun 17, 2022Updated 4 years ago
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆46Dec 4, 2017Updated 8 years ago
- A collection and conversion of WARN notices from California☆12May 13, 2016Updated 10 years ago
- A web service that generates static maps☆18Dec 30, 2025Updated 6 months ago
- ☆17Apr 30, 2026Updated 2 months ago
- A simple app for visualising text embeddings☆24Jul 20, 2025Updated last year
- A robust web archive analytics toolkit☆144Updated this week
- React Component for Uploading and Viewing your CSV File as a table☆15Feb 18, 2023Updated 3 years ago
- 독거노인: 독일에서 일하는 (한국인) 노동자를 위한 (한국어) 정보☆11Jun 7, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Handy tool for Object Storage performance benchmark☆12Sep 8, 2025Updated 10 months ago
- The code to generate a top 20 score in the amazon classification challenge using Driverless AI's predictions and feature engineering : In…☆19Dec 2, 2017Updated 8 years ago
- Hotel data scraper from Google Maps service☆11Jul 6, 2022Updated 4 years ago
- Didactic Web crawler for Web Search Engines (CS 6913) course at NYU☆10Dec 8, 2022Updated 3 years ago
- Extraction code used to create the Dresden Web Table Corpus☆14Feb 25, 2015Updated 11 years ago
- ☆10Jul 7, 2026Updated 2 weeks ago
- Converts brat standoff format to JSONL format☆13Jan 29, 2022Updated 4 years ago
- PathVis visualises traceroutes☆11Jan 25, 2024Updated 2 years ago
- ☆12Sep 9, 2022Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.☆12Oct 12, 2018Updated 7 years ago
- In-BoXBART: Get Instructions into Biomedical Multi-task Learning☆15Aug 23, 2022Updated 3 years ago
- Common Crawl Index Server☆71Feb 28, 2025Updated last year
- An environment for benchmarking commonsense agents☆30Aug 19, 2020Updated 5 years ago
- Inverse Rosenblatt Transform (Conditional Distribution) + MCMC sampling using Tensor Train approximation☆14Mar 17, 2025Updated last year
- ☆46Apr 13, 2022Updated 4 years ago
- ☆12Mar 5, 2021Updated 5 years ago