gzipstream allows Python to process multi-part gzip files from a streaming source
☆23Feb 24, 2017Updated 9 years ago
Alternatives and similar repositories for gzipstream
Users that are interested in gzipstream are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python library for reading and writing warc files☆250Mar 7, 2022Updated 4 years ago
- Deployment of pywb as a CommonCrawl Index Server☆22Oct 6, 2017Updated 8 years ago
- Collect, store and analyze your Internet provider's usage stats.☆16Sep 27, 2015Updated 10 years ago
- Extract video features. Currently, the models includes I3D, will be continuously updated.☆12Jun 4, 2020Updated 6 years ago
- Machine assisted dossiers☆19Oct 12, 2017Updated 8 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A space for code and projects around analysing news content☆23Feb 8, 2018Updated 8 years ago
- Turning news into events since 2014.☆52May 1, 2017Updated 9 years ago
- List of Solid talks☆17Nov 25, 2019Updated 6 years ago
- Code for "So similar and yet incompatible: Toward the automated identification of semantically compatible words" in NAACL 2015 proceedi…☆11May 11, 2015Updated 11 years ago
- A low-overhead sampling memory profiler for Python 3☆31Apr 10, 2023Updated 3 years ago
- Python library for reading ClueWeb09's warc files☆21Sep 6, 2018Updated 8 years ago
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆46Dec 4, 2017Updated 8 years ago
- A generalized input-label embedding for text classification☆24Dec 6, 2019Updated 6 years ago
- Common web archive utility code.☆65Sep 1, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Streaming WARC/ARC library for fast web archive IO☆474Jun 10, 2026Updated 3 months ago
- crdts on ipfs☆11Dec 2, 2015Updated 10 years ago
- videojs plugin, display marker point on progress bar.☆11Oct 25, 2023Updated 2 years ago
- Esper instance for TV news analysis☆40Nov 11, 2022Updated 3 years ago
- pry-bond provides input completion in pry through the `bond` rubygem☆12Nov 25, 2014Updated 11 years ago
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆54Jun 12, 2020Updated 6 years ago
- A rust crate to create & manage cluster☆11Jul 19, 2025Updated last year
- A process control system written in shell, for development.☆14Feb 15, 2021Updated 5 years ago
- contains data to be used with machine learning☆10Jul 28, 2017Updated 9 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Chainer implementation of deep-INFOMAX☆34Aug 29, 2018Updated 8 years ago
- Strongly typed javascript objects, self-validating, detailed error reports☆12Aug 13, 2020Updated 6 years ago
- Visual Verb Sense Disambiguation☆13Apr 26, 2019Updated 7 years ago
- An Application which is recording video directly from web (browser) to server (Kurento Media Server) -- Testing App☆10Mar 12, 2019Updated 7 years ago
- classify a job description (or noisy job title) into a ONET job title☆19Oct 14, 2016Updated 9 years ago
- A C++ json/xml dumper/serialization library☆14Apr 5, 2015Updated 11 years ago
- Extract transform load CLI tool for extracting small and middle data volume from sources (databases, csv files, xls files, gspreadsheets)…☆11Aug 2, 2026Updated last month
- ☆10Dec 6, 2022Updated 3 years ago
- A distributed system for mining common crawl using SQS, AWS-EC2 and S3☆22Jun 24, 2014Updated 12 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆193Apr 29, 2022Updated 4 years ago
- Large-scale city camera video dataset☆11Jul 20, 2020Updated 6 years ago
- These map reduce functions use Common Crawl data to look at the spread of congressional legislation on the internet☆23Mar 6, 2017Updated 9 years ago
- Web service for image file/image URL classification without uploading.☆16May 27, 2022Updated 4 years ago
- React Native iOS Screen Recorder☆13Jan 26, 2023Updated 3 years ago
- 🌐 Tiny API to get user's favorited items on Hacker News☆12Oct 18, 2022Updated 3 years ago
- Redis server built over grpc☆13Apr 13, 2016Updated 10 years ago