maxcountryman / warc-parquet
🗄️ A simple CLI for converting WARC to Parquet.
☆106Updated last week
Related projects ⓘ
Alternatives and complementary repositories for warc-parquet
- Scale to zero Seafowl hosting with Cloud Run☆39Updated last year
- ☆109Updated 4 months ago
- Gavin Mendel-Gleason's blog☆86Updated 10 months ago
- What if an HNSW index was just a file, and you could serve it from a CDN, and search it directly in the browser?☆86Updated 6 months ago
- A small language that compiles to WebAssembly Text format☆74Updated 6 months ago
- ZSV Utility for converting json to/from zip-separated-values☆58Updated 5 months ago
- Block Erasure Format - An extensible, fast, and usable file utility to encode and decode interleaved erasure coded streams of data.☆57Updated 6 months ago
- Testing various image matching algorithms' performance on the Pinecone vector DB☆43Updated last year
- Module Oriented Large Archive Specialized Slow Exhaustive Searcher☆113Updated 9 years ago
- Shell scripting for serverless☆141Updated 2 years ago
- A simple performant GeoIP server written in Rust using MaxMind DBs with auto database update☆45Updated this week
- WarcDB: Web crawl data as SQLite databases.☆394Updated 4 months ago
- Beating the `bisect` module's implementation using C-extensions.☆30Updated last year
- ☆162Updated 5 months ago
- the fastest CSV SQLite extension, written in Rust☆122Updated last year
- Retry a command with exponential backoff and jitter (+ Starlark expressions)☆119Updated this week
- Quality News - Towards a fairer ranking formula for Hacker News☆52Updated this week
- A js library to incorporate HN comments to any website☆31Updated 6 months ago
- Code to accompany blog post https://reorchestrate.com/posts/sqlite-transactions☆67Updated 4 months ago
- A Go program to split large JSON files into many jsonl files☆60Updated last year
- Command-line tool to remotely execute code in the cloud☆134Updated 2 years ago
- ☆44Updated 2 years ago
- Dumfederated gRPC social network implemented in Rust/Tonic/Diesel with both Flutter and React (web+native) frontends. 🐕💩EZ to deploy to…☆63Updated last week
- A safe, stateful rules language for event streams☆113Updated last year
- Gutenberg the 💩 out of it!☆55Updated last month
- Compile Justfiles to portable shell scripts☆141Updated last week
- abuse ImageMagick (or GraphicsMagick) to create arbitrary files☆53Updated last week
- SQLite3 extension for read-only HTTP(S) database access☆51Updated last year
- a file transfer service utilizing quic☆61Updated 2 months ago