Florents-Tselai / WarcDBLinks
WarcDB: Web crawl data as SQLite databases.
☆398Updated 10 months ago
Alternatives and similar repositories for WarcDB
Users that are interested in WarcDB are comparing it to the libraries listed below
Sorting:
- A SQLite extension for reading large files line-by-line (NDJSON, logs, txt, etc.)☆398Updated last year
- A SQLite extension which loads a Google Sheet as a virtual table.☆518Updated 2 years ago
- A SQLite extension for querying, manipulating, and creating HTML elements.☆385Updated last year
- Query SQLite files in S3 using s3fs☆506Updated 2 years ago
- 🗄️ A simple CLI for converting WARC to Parquet.☆110Updated 3 months ago
- Python module to parse ingredient names. Splitting them into the ingredient, unit and quantity. It is trained on a publicly available dat…☆153Updated last year
- Functional UUIDs for Python.☆148Updated 4 years ago
- ☆114Updated 4 years ago
- A self-hosted live video streaming platform with Discord authentication, auto-recording and more!☆349Updated 10 months ago
- A generator for OpenAPI 3☆97Updated 4 years ago
- Interactive visualization library for concept map☆91Updated 6 years ago
- Simple Python Calculation Engine☆134Updated 3 years ago
- shell-based query tool☆164Updated last year
- Rsync-based time machine for Linux, written in Python, for local and remote backups.☆169Updated last year
- Execute a command when something changes☆458Updated last year
- Module Oriented Large Archive Specialized Slow Exhaustive Searcher☆113Updated 9 years ago
- Repository for Pipes☆272Updated 10 months ago
- Minimalist Error collection Service compatible with Rollbar clients. Sentry or Rollbar alternative.☆387Updated 3 years ago
- ☆230Updated 2 years ago
- Minimalist log collector☆115Updated 4 months ago
- Create a SQLite database containing metadata from Google Drive☆159Updated 2 months ago
- Distributed Embeddable Database☆255Updated 2 years ago
- The various scripts I use to back up my home computers using ssh and rsync☆199Updated 4 years ago
- Scrapy rotation proxy package with advanced functions☆95Updated 2 years ago
- Dockerized local and offline backing up of PostgresQL with rotation and compression.☆210Updated last year
- Shell scripting for serverless☆140Updated 3 years ago
- Lockbox is a forward proxy for making third party API calls.☆378Updated last year
- Parse natural language time and date expressions in python☆198Updated last year
- α-Indirect Control in Onion-like Networks☆148Updated last year
- DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with …☆814Updated 3 years ago