Florents-Tselai / WarcDBLinks
WarcDB: Web crawl data as SQLite databases.
☆406Updated last year
Alternatives and similar repositories for WarcDB
Users that are interested in WarcDB are comparing it to the libraries listed below
Sorting:
- A SQLite extension which loads a Google Sheet as a virtual table.☆519Updated 2 years ago
- A SQLite extension for querying, manipulating, and creating HTML elements.☆389Updated 2 years ago
- A SQLite extension for reading large files line-by-line (NDJSON, logs, txt, etc.)☆403Updated last year
- Query SQLite files in S3 using s3fs☆509Updated 3 years ago
- Python module to parse ingredient names. Splitting them into the ingredient, unit and quantity. It is trained on a publicly available dat…☆153Updated last year
- Create a SQLite database containing metadata from Google Drive☆161Updated 6 months ago
- A self hosted recommendation feed generated from your browsing habits☆315Updated 3 years ago
- A self-hosted live video streaming platform with Discord authentication, auto-recording and more!☆350Updated last year
- 🗄️ A simple CLI for converting WARC to Parquet.☆112Updated 7 months ago
- Rsync-based time machine for Linux, written in Python, for local and remote backups.☆169Updated 2 years ago
- Repository for Pipes☆273Updated last month
- The various scripts I use to back up my home computers using ssh and rsync☆199Updated 4 years ago
- A generator for OpenAPI 3☆97Updated 4 years ago
- a simple website for sharing table data - with an API☆396Updated 3 months ago
- ☆114Updated 4 years ago
- Shell scripting for serverless☆140Updated 3 years ago
- Replace Splunk in your small company with this one weird trick!☆412Updated 6 months ago
- Extremely low cost, off-site backup/restore using AWS S3 Glacier Deep Archive☆253Updated 3 months ago
- Reverse Geocode for OpenStreetmap☆129Updated last year
- Template repository for setting up shot-scraper☆255Updated 6 months ago
- Module Oriented Large Archive Specialized Slow Exhaustive Searcher☆113Updated 10 years ago
- Scrapy rotation proxy package with advanced functions☆95Updated 3 years ago
- Simple Python Calculation Engine☆134Updated 3 years ago
- Minecraft Interactive world builder☆304Updated this week
- Minimalist log collector☆114Updated 8 months ago
- Command-line tool to remotely execute code in the cloud☆134Updated 3 years ago
- Functional UUIDs for Python.☆148Updated 4 years ago
- Dockerized local and offline backing up of PostgresQL with rotation and compression.☆209Updated last year
- α-Indirect Control in Onion-like Networks☆148Updated last year
- Geocode rows in a SQLite database table☆238Updated 2 years ago