gzipstream allows Python to process multi-part gzip files from a streaming source
☆23Feb 24, 2017Updated 9 years ago
Alternatives and similar repositories for gzipstream
Users that are interested in gzipstream are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python library for reading and writing warc files☆249Mar 7, 2022Updated 4 years ago
- Deployment of pywb as a CommonCrawl Index Server☆22Oct 6, 2017Updated 8 years ago
- A space for code and projects around analysing news content☆23Feb 8, 2018Updated 8 years ago
- A simple ElasticSearch plugin wrapping around the search endpoint to provide Rocchio query expansion☆18Aug 5, 2017Updated 8 years ago
- List of Solid talks☆17Nov 25, 2019Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Find rss, atom, xml, and rdf feeds on webpages☆31Nov 6, 2025Updated 8 months ago
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆46Dec 4, 2017Updated 8 years ago
- A Python port of the Perl address parser available at http://search.cpan.org/~timb/Geo-StreetAddress-US-1.03/US.pm☆26Jan 31, 2019Updated 7 years ago
- Common web archive utility code.☆65Jul 3, 2026Updated 3 weeks ago
- OSHW: Automatic audio input switcher based on audio activity☆10Aug 5, 2014Updated 11 years ago
- Streaming WARC/ARC library for fast web archive IO☆462Jun 10, 2026Updated last month
- crdts on ipfs☆11Dec 2, 2015Updated 10 years ago
- The code reproduces the results of the experiments in the paper. In particular, it performs experiments in which machine-learning models …☆21Aug 16, 2021Updated 4 years ago
- Esper instance for TV news analysis☆40Nov 11, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆53Jun 12, 2020Updated 6 years ago
- This is a Vim HTML compiler for validating against http://validator.nu.☆14Nov 28, 2017Updated 8 years ago
- piku experiments with "build a web app fast" prototyping☆13Aug 21, 2021Updated 4 years ago
- contains data to be used with machine learning☆10Jul 28, 2017Updated 8 years ago
- Strongly typed javascript objects, self-validating, detailed error reports☆12Aug 13, 2020Updated 5 years ago
- Visual Verb Sense Disambiguation☆13Apr 26, 2019Updated 7 years ago
- classify a job description (or noisy job title) into a ONET job title☆19Oct 14, 2016Updated 9 years ago
- A C++ json/xml dumper/serialization library☆14Apr 5, 2015Updated 11 years ago
- A distributed system for mining common crawl using SQS, AWS-EC2 and S3☆22Jun 24, 2014Updated 12 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆194Apr 29, 2022Updated 4 years ago
- A library of examples showing how to use the Common Crawl corpus (2008-2012, ARC format)☆66Aug 5, 2016Updated 9 years ago
- React Native iOS Screen Recorder☆13Jan 26, 2023Updated 3 years ago
- Code for the Human-related Object Detection based on Natural Language Parsing of Image Query Expressions article☆13Aug 8, 2017Updated 8 years ago
- python code for my variational RNN method☆14Jul 28, 2016Updated 9 years ago
- A simple development of linear logic in Coq.☆13Mar 22, 2025Updated last year
- Redis server built over grpc☆13Apr 13, 2016Updated 10 years ago
- A VR headset library for Rust programs targeting the Oculus Rift.☆10Nov 18, 2015Updated 10 years ago
- ☆12Feb 6, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Sample python app for deployment with piku☆12Nov 3, 2021Updated 4 years ago
- Alternative password shadowing scheme☆10Updated this week
- Python Flask-RESTful template for cookiecutter☆11Mar 31, 2016Updated 10 years ago
- Axon provides powerful and concise models for interactive simulations, based on observable Properties and related patterns.☆12Jul 1, 2026Updated 3 weeks ago
- Creating user interfaces for data science with Jupyter widgets☆11Oct 28, 2017Updated 8 years ago
- ☆12Oct 3, 2024Updated last year
- A nginx container containing rtmp module and hdw-player for visualizing the stream.☆13Mar 1, 2026Updated 4 months ago