Read JSON lines (jl) files, including gzipped and broken
β37Apr 8, 2026Updated 7 months ago
Alternatives and similar repositories for json-lines
Users that are interested in json-lines are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A component that tries to avoid downloading duplicate contentβ28Apr 8, 2026Updated 7 months ago
- πΏStones: Persistent key-value containers, compatible with Python dictβ17Jul 15, 2024Updated 2 years ago
- Flatten, format, and export any JSON-like data to CSV (or any other string output).β17Sep 13, 2021Updated 5 years ago
- β20Nov 5, 2026Updated 2 weeks ago
- Scrapy middleware for the autologinβ36Apr 8, 2026Updated 7 months ago
- Managed Database hosting by DigitalOcean β’ AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A Scrapy extension to log items coverage when the spider shuts downβ18Apr 11, 2020Updated 6 years ago
- A fork of http://pydispatcher.sourceforge.net/ with PyPy supportβ16Jul 3, 2017Updated 9 years ago
- A classifier for detecting soft 404 pagesβ67Apr 8, 2026Updated 7 months ago
- Python clients for Zyte AutoExtract APIβ41Jan 17, 2022Updated 4 years ago
- Repository for ru-syntax command line tool.β14Mar 8, 2022Updated 4 years ago
- Formasaurus tells you the type of an HTML form and its fields using machine learningβ120Apr 8, 2026Updated 7 months ago
- Automatic unit test generation for Scrapy.β58Jul 12, 2021Updated 5 years ago
- Deprecated HubStorage client library - please use python-scrapinghub>=1.9.0 insteadβ16Dec 5, 2016Updated 9 years ago
- A library to make it easier to load input URLs to start scrapy processesβ14Feb 21, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform β’ AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Extract price amount and currency symbol from a raw text stringβ351Nov 2, 2026Updated 2 weeks ago
- A scrapy extension to sync `.scrapy` folder to an S3 bucketβ18Mar 28, 2022Updated 4 years ago
- [TMLR] "Can You Win Everything with Lottery Ticket?" by Tianlong Chen, Zhenyu Zhang, Jun Wu, Randy Huang, Sijia Liu, Shiyu Chang, Zhangyβ¦β10Sep 8, 2022Updated 4 years ago
- A notebook that runs GPT-Neo with low vram (6 gb) and cuda acceleration by loading it into gpu memory in smaller parts.β13May 25, 2021Updated 5 years ago
- Python-based high-performance web tools - see http://chris.improbable.org/2010/01/30/quickly-testing-your-sites-using-webtoolbox/ for an β¦β21Oct 24, 2017Updated 9 years ago
- A dataset of popular pages (taken from <dir.yahoo.com>) with manually marked up semantic blocks.β15Feb 9, 2014Updated 12 years ago
- A simple, line-oriented tabular data formatβ10Jan 20, 2018Updated 8 years ago
- RUSSE: Russian Semantic Evaluation.β15Mar 1, 2022Updated 4 years ago
- A simple algorithm for clustering web pages, suitable for crawlersβ33Mar 6, 2017Updated 9 years ago
- Managed Database hosting by DigitalOcean β’ AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.β12Apr 8, 2026Updated 7 months ago
- Library for annotation-based dependency injectionβ24Nov 1, 2026Updated 2 weeks ago
- A command line file encryption toolβ10Dec 1, 2019Updated 6 years ago
- Site Hound (previously THH) is a Domain Discovery Toolβ24Apr 8, 2026Updated 7 months ago
- Dataframes for Golangβ14Apr 8, 2021Updated 5 years ago
- β19Oct 6, 2026Updated last month
- β10Aug 6, 2017Updated 9 years ago
- β14Jun 27, 2019Updated 7 years ago
- Given a new image, determine if it is likely derived from a known image.β21Apr 8, 2026Updated 7 months ago
- End-to-end encrypted cloud storage - Proton Drive β’ AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Comparing M2M and mT5 on a rare language pairs, blog post: https://medium.com/@abdessalemboukil/comparing-facebooks-m2m-to-mt5-in-low-reβ¦β16Jun 25, 2021Updated 5 years ago
- Chu-Liu-Edmonds maximum spanning algorithm from TurboParser for use within Pythonβ11Mar 9, 2024Updated 2 years ago
- Adaptive crawler which uses Reinforcement Learning methodsβ167Apr 8, 2026Updated 7 months ago
- extractor chinese synonyms in large corpusβ11Jul 20, 2016Updated 10 years ago
- ιΈθͺ²ε°εΉ«ζβ11Dec 14, 2018Updated 7 years ago
- Implementation of data dimensionality reduction algorithms SVD and CUR without using library functions.β10Jul 24, 2017Updated 9 years ago
- Broad crawler for domain discoveryβ19Apr 8, 2026Updated 7 months ago
Are these results useful?