GP89 / FileQueue
A thread-safe queue which queues items on disk, with an optional in memory buffer. Can put and get any pickle-able object into a buffer of a specified size (optional), any overflow will get put to a gzip file to keep excessive amounts of queued items out of memory
☆22Updated 5 years ago
Alternatives and similar repositories for FileQueue:
Users that are interested in FileQueue are comparing it to the libraries listed below
- Python C-based extension implementing fast integer bit sets☆22Updated 6 months ago
- Find which links on a web page are pagination links☆29Updated 8 years ago
- Detect and classify pagination links☆15Updated 4 years ago
- An index data structure for approximate string search.☆23Updated 5 years ago
- Extract, parse and populate templates from strings☆27Updated 6 years ago
- Get creation time of files for any platform - no external dependencies☆16Updated 5 years ago
- Use Rope to help convert names in a Python project to conform with PEP-8.☆49Updated 4 years ago
- Pyed Piper tool by Toby Rosen at Sony Imageworks converted to Python 3☆35Updated 3 years ago
- The most basic Text::Unidecode port (licensed under Artistic License or GPL or GPLv2+ - choose whatever you want)☆66Updated 2 years ago
- Repackage Bit.ly's data_hacks histogram for convenient script use.☆14Updated 9 months ago
- Just is a wrapper to automagically read/write a file based on extension☆51Updated 11 months ago
- Stream JSON parser for Python☆48Updated 2 years ago
- JupyterLab extension to explore CPython Bytecode☆62Updated 2 years ago
- A disk-based key/value store in Python with no dependencies.☆21Updated 10 years ago
- minimalist event system for Python☆85Updated 5 years ago
- Extra features for Python's JSON: comments, order, numpy, pandas, datetimes, and many more! Simple but customizable.☆160Updated 8 months ago
- Pizco is Python module/package that allows python objects to communicate via ZMQ. Objects can be exposed to other process in the same com…☆57Updated 9 years ago
- Creating user interfaces for data science with Jupyter widgets☆11Updated 7 years ago
- extract difference between two html pages☆32Updated 6 years ago
- A scrapy extension to store requests and responses information in storage service☆26Updated 3 years ago
- A component that tries to avoid downloading duplicate content☆27Updated 6 years ago
- Implementation of a pyfilesystem2 filesystem for Google Drive☆27Updated 5 months ago
- Exclude/ignore files in a directory (using .gitignore like syntax), compute hash, search projects for an entire directory tree, gzip comp…☆74Updated 5 years ago
- WebAnnotator is a tool for annotating Web pages. WebAnnotator is implemented as a Firefox extension (https://addons.mozilla.org/en-US/fi…☆48Updated 3 years ago
- A backend for ZODB that stores pickles in a relational database.☆55Updated 2 months ago
- A text parser.☆30Updated 3 years ago
- xmlsjon converts XML into Python dictionary structures (trees, like in JSON) and vice-versa.☆123Updated 2 years ago
- Modern, declarative argument parser for Python 3.6+☆36Updated 7 years ago
- Proxies and wrappers for ordinary Python objects☆21Updated 9 years ago
- Generic Environment for Context-Aware Correction of Orthography☆22Updated 2 years ago