A whirlwind tour of Common Crawl's data using Python
☆46Jun 15, 2026Updated 3 months ago
Alternatives and similar repositories for whirlwind-python
Users that are interested in whirlwind-python are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python binding for gumbo-parser using Cython☆14Aug 16, 2016Updated 10 years ago
- Selected code and data for The Online Books Page and related applications☆12Sep 1, 2026Updated 2 weeks ago
- Crowd-sourced lists of urls to help Common Crawl crawl under-resourced languages. See https://github.com/commoncrawl/web-languages-code/ …☆72Aug 24, 2026Updated 3 weeks ago
- Decodes Compact Disc data from microscope images of a CD's surface☆12Jan 14, 2023Updated 3 years ago
- ☆17Nov 26, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Python tool for batch visual question answering (BVQA).☆14Sep 18, 2025Updated last year
- Code and Slides for PyData London 2022 Tutorial on MPI and Python☆11Jun 18, 2022Updated 4 years ago
- Material parsers and other tools, scripts Initially developed for Grobid Superconductor☆14Feb 21, 2025Updated last year
- An Interactive Dashboard Providing Statistical Indicators and Analysis for EU Countries.☆10Aug 18, 2026Updated last month
- Load, build and explore Patstat using the Google Cloud Platform☆10Jan 19, 2019Updated 7 years ago
- Leveraging LLMs for Post-OCR Correction of Historical Newspapers☆18May 12, 2026Updated 4 months ago
- Convert ALTO XML to plain text + minimal metadata☆17Oct 17, 2024Updated last year
- Converter from UD-trees to BART representation☆35Mar 6, 2024Updated 2 years ago
- Intentional is an open-source framework to build reliable LLM chatbots that actually talk and behave as you expect.☆12Dec 31, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Repository hosting the common code for the entity-fishing clients☆10May 18, 2026Updated 4 months ago
- ☆10May 18, 2017Updated 9 years ago
- ☆12Jul 10, 2022Updated 4 years ago
- Analytic platform for the HAL research archive (in development)☆12Oct 2, 2020Updated 5 years ago
- Poor man's simple harvester for arXiv resources☆14Jul 14, 2023Updated 3 years ago
- Specification of a stand-off element for the TEI guidelines☆12Apr 29, 2021Updated 5 years ago
- Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki☆28Jul 31, 2024Updated 2 years ago
- A tool for exporting an Rdio collection to a portable file format like markdown.☆11Sep 4, 2016Updated 10 years ago
- A collection of Islandora microservices, lovingly known as Crayfish.☆10Updated this week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Like Prometheus, but for logs.☆11Updated this week
- Golang WARC (Web ARChive) Library☆30Aug 6, 2019Updated 7 years ago
- utility to fetch provenance information from Internet Archive's Wayback Machine☆15Feb 5, 2026Updated 7 months ago
- ☆18Apr 29, 2026Updated 4 months ago
- Pure VimL fuzzy file finder for vim.☆17Aug 14, 2019Updated 7 years ago
- Bouton ISTEX : extension web capable d'insérer dynamiquement sur la page web consultée un lien vers le fulltext d'un document si ce dern…☆11May 30, 2023Updated 3 years ago
- WindSR Dataset contains more than 22,000 pairs of HR/LR wind speed images, which are processed using the NASA's GEOS-5 Nature Run dataset…☆12Jan 18, 2024Updated 2 years ago
- Utility to compile string of chemical terms into data structure with chemical formula and composition☆14Sep 17, 2021Updated 5 years ago
- Dockerfiles for Avalon Media System - http://github.com/avalonmediasystem/avalon☆10Sep 9, 2026Updated last week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆23Updated this week
- Fcrepo4 webapp plus optional fcrepo dependencies☆13Sep 30, 2020Updated 5 years ago
- This repo contains various examples on different APIs and UIs and Metabase deployment specific to Oracle connection☆13Jan 29, 2024Updated 2 years ago
- Badge for Javadoc (or any other jvm doc). redirect to sonatype or javadoc.io☆16Aug 9, 2021Updated 5 years ago
- Softcite software mention recognizer, finding mentions and citations to software from within the academic literature☆85Sep 1, 2026Updated 2 weeks ago
- A Lit web-component for viewing a Whisper JSON transcript file☆14Feb 12, 2026Updated 7 months ago
- A Linux driver that simulates a serial port and allows control of modem lines and such☆19Nov 19, 2025Updated 10 months ago