WarcDB: Web crawl data as SQLite databases.
β404Jul 13, 2024Updated last year
Alternatives and similar repositories for WarcDB
Users that are interested in WarcDB are comparing it to the libraries listed below
Sorting:
- ποΈ A simple CLI for converting WARC to Parquet.β113Feb 12, 2025Updated last year
- A SQLite extension for querying, manipulating, and creating HTML elements.β396Aug 6, 2023Updated 2 years ago
- abuse ImageMagick (or GraphicsMagick) to create arbitrary filesβ54Feb 3, 2026Updated last month
- Command line tool for digging into WARC filesβ51Feb 27, 2026Updated last week
- Query Excel spredsheets (.xlsx, .xls, .ods) using SQLiteβ1,304Mar 9, 2025Updated last year
- The ultimate set of SQLite extensionsβ4,280Feb 10, 2026Updated 3 weeks ago
- The best RSS Search experience you can findβ621Jan 19, 2023Updated 3 years ago
- A SQLite extension for making HTTP requests purely in SQLβ261Feb 9, 2025Updated last year
- A platform for collecting, analyzing, and visualizing social media data.β13Dec 27, 2020Updated 5 years ago
- Add website scraping abilities to Datasetteβ66Mar 4, 2023Updated 3 years ago
- FUSE-based file system for replicating SQLite databases across a cluster of machinesβ4,693Apr 22, 2025Updated 10 months ago
- CG/SQL is a compiler that converts a SQL Stored Procedure like language into C for SQLite. SQLite has no stored procedures of its own. β¦β403May 1, 2023Updated 2 years ago
- A SQLite extension that brings column-oriented tables to SQLiteβ683Mar 21, 2024Updated last year
- This is a simple graph database in SQLite, inspired by "SQLite as a document database"β1,503Feb 15, 2025Updated last year
- pystitcher stitches your PDF files together, generating nice customizable bookmarks for you using a declarative markdown file as inputβ397Apr 25, 2025Updated 10 months ago
- App to easily query, script, and visualize data from every database, file, and API.β2,959Nov 10, 2023Updated 2 years ago
- Use SQL to instantly query spreadsheets, sheets, and cell data from Google Sheets. Open source CLI. No DB required.β33Mar 1, 2026Updated last week
- A SQLite extension for reading large files line-by-line (NDJSON, logs, txt, etc.)β402Oct 7, 2023Updated 2 years ago
- Go sqlite3 http vfs: query sqlite databases over http with range headersβ230Apr 9, 2023Updated 2 years ago
- β17Oct 2, 2025Updated 5 months ago
- Query SQLite files in S3 using s3fsβ512Sep 14, 2022Updated 3 years ago
- Query sqlite via json+httpβ555Feb 24, 2026Updated last week
- A SQLite extension which loads a Google Sheet as a virtual table.β517Oct 21, 2022Updated 3 years ago
- Replicate postgres to SQLite on the edgeβ1,036Jun 17, 2024Updated last year
- DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with β¦β815Dec 5, 2021Updated 4 years ago
- Python CLI utility and library for manipulating SQLite databasesβ2,013Jan 21, 2026Updated last month
- Web archive index server based on RocksDBβ38Mar 2, 2026Updated last week
- Distributed, MVCC SQLite that runs on FoundationDB.β1,526Feb 25, 2026Updated last week
- Static Site Generator for Viewing Web Archives (in WACZ) formatβ30Jun 30, 2023Updated 2 years ago
- π§© Proposal to allow user scripts like "expand comments", "hide popups", "fill out this form", etc. to be reusable across pure browser enβ¦β19Jul 11, 2025Updated 7 months ago
- Create and edit WARC and WACZ filesβ24Dec 6, 2024Updated last year
- A Memento Aggregator CLI and Server in Goβ77Mar 4, 2025Updated last year
- Mycelite is a SQLite extension that allows you to synchronize changes from one instance of SQLite to another.β1,097Sep 25, 2023Updated 2 years ago
- Specifications developed and maintained by the Webrecorder community.β140Oct 16, 2025Updated 4 months ago
- An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services includβ¦β2,150Mar 2, 2026Updated last week
- πΎ dn - offline full-text search and archiving for your Chromium-based browser.β3,891Updated this week
- Writing SQL can be easier - pine makes it happen!β12Updated this week
- Automatically create a GraphQL server from a SQLite database or a SQL fileβ1,070Jun 6, 2021Updated 4 years ago
- sqlite as a filesystemβ286May 3, 2025Updated 10 months ago