maxcountryman / warc-parquetLinks
🗄️ A simple CLI for converting WARC to Parquet.
☆112Updated 5 months ago
Alternatives and similar repositories for warc-parquet
Users that are interested in warc-parquet are comparing it to the libraries listed below
Sorting:
- ☆109Updated 3 months ago
- Scale to zero Seafowl hosting with Cloud Run☆37Updated 2 years ago
- A safe, stateful rules language for event streams☆114Updated 2 years ago
- ZSV Utility for converting json to/from zip-separated-values☆56Updated last year
- Create a SQLite database containing metadata from Google Drive☆161Updated 4 months ago
- SQL transformation tool for DuckDB written in Rust☆56Updated 4 months ago
- Testing various image matching algorithms' performance on the Pinecone vector DB☆43Updated 2 years ago
- WarcDB: Web crawl data as SQLite databases.☆404Updated last year
- SQLite3 extension for read-only HTTP(S) database access☆54Updated last year
- ayb makes it easy to create databases, share them with collaborators, and query them from a web application or the command line☆76Updated this week
- the fastest CSV SQLite extension, written in Rust☆137Updated 5 months ago
- webidx is a client-side search engine for static websites.☆61Updated 4 months ago
- Gavin Mendel-Gleason's blog☆89Updated last year
- A Go program to split large JSON files into many jsonl files☆61Updated 2 years ago
- Shell scripting for serverless☆140Updated 3 years ago
- ☆26Updated last year
- Documentation and demonstration of how to build WASM versions of SQLite with extensions embedded☆28Updated 4 months ago
- jq extension for SQLite.☆100Updated last year
- A library for parsing and executing Excel-style formulas☆58Updated 2 years ago
- Beating the `bisect` module's implementation using C-extensions.☆30Updated 2 years ago
- Multi-model transactional embedded database☆68Updated 7 months ago
- ☆163Updated last year
- Zig library for HyperLogLog estimation☆89Updated last year
- Fast similarity search using DuckDB☆138Updated 9 months ago
- Reverse Geocode for OpenStreetmap☆129Updated 10 months ago
- Uniform eXchange Format (uxf) is a plain text human readable optionally typed storage format that supports custom types. It may serve as …☆2Updated last year
- Dumfederated gRPC social network implemented in Rust/Tonic/Diesel with a bundled React (web+native) frontend. 🐕💩EZ to deploy to your k8…☆66Updated 2 weeks ago
- Block Erasure Format - An extensible, fast, and usable file utility to encode and decode interleaved erasure coded streams of data.☆58Updated last year
- Code to accompany blog post https://reorchestrate.com/posts/sqlite-transactions☆65Updated last year
- What if an HNSW index was just a file, and you could serve it from a CDN, and search it directly in the browser?☆106Updated 3 months ago