Trough: Big data, small databases.
☆43Jul 25, 2024Updated 2 years ago
Alternatives and similar repositories for trough
Users that are interested in trough are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Convert HTTP Archive (HAR) -> Web Archive (WARC) format☆55Oct 21, 2018Updated 8 years ago
- Sort-friendly URI Reordering Transform (SURT) python module☆48Sep 11, 2025Updated last year
- A queue-controlled browser automation tool for improving web crawl quality☆69May 28, 2026Updated 5 months ago
- The god of human readable numbers☆13Oct 18, 2019Updated 7 years ago
- Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki☆28Jul 31, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- WARC writing MITM HTTP/S proxy☆468Jun 17, 2026Updated 4 months ago
- Domain Ontology to model web archiving artefacts as Semantic objects and describe web archiving and web preservation activities.☆12Sep 3, 2026Updated last month
- A Memento Aggregator CLI and Server in Go☆83Apr 9, 2026Updated 6 months ago
- Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)☆178Aug 18, 2025Updated last year
- A tool for detecting viruses and NSFW material in WARC files☆18Jul 15, 2026Updated 3 months ago
- visualizations/charts for media collections, based on mediainfo☆14Sep 15, 2022Updated 4 years ago
- A tool for collection archival slivers of the web and web archives☆20Jun 1, 2026Updated 4 months ago
- WASAPI data transfer APIs☆51Apr 23, 2022Updated 4 years ago
- An HTTP Proxy that archives all intercepted traffic.☆21Aug 26, 2014Updated 12 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Docker Compose based system for running remote browsers (including Flash and Java support) connected to web archives☆16Jun 10, 2021Updated 5 years ago
- Tools to analyze web archives☆20Jul 12, 2016Updated 10 years ago
- An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed…☆164Oct 8, 2025Updated last year
- ☆23Feb 22, 2024Updated 2 years ago
- An implementation of event-driven workflows in Go☆14Aug 12, 2025Updated last year
- Centralised repository for WARC usage specifications.☆139Sep 20, 2026Updated last month
- Archive Research Services Workshop☆31Sep 29, 2017Updated 9 years ago
- golang readers for ARC and WARC webarchive formats☆20Apr 3, 2023Updated 3 years ago
- Download GitHub repositories☆13May 10, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Easily add authentication to your postgrest API☆25Feb 14, 2019Updated 7 years ago
- Python script to create CDX index files of WARC data☆22Sep 4, 2025Updated last year
- Cron job to manage ZFS snapshots☆13Jan 14, 2026Updated 9 months ago
- ☆29Nov 28, 2016Updated 9 years ago
- demos using the OpenRNDR framework☆13Mar 27, 2020Updated 6 years ago
- DEPRECATED - Website, assets, curriculum, and any other public resources for the Ascend Project (ascendproject.org)☆17Oct 1, 2020Updated 6 years ago
- Add editing UI and other power-user features to Datasette.☆14Mar 4, 2023Updated 3 years ago
- Demo app built using AngularJS with Backand serving as the back end☆13Mar 1, 2017Updated 9 years ago
- An interactive shell for inspecting PostgreSQL data files at the page level. Open any heap or index file and navigate through its 8KB pag…☆17Mar 6, 2026Updated 7 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- OAI-PMH plugin for Solr☆23May 12, 2021Updated 5 years ago
- An evil web server.☆13May 9, 2015Updated 11 years ago
- lod-explorativ is a prototype of a Svelte webapp which let you explore bibliographic resources from a topic's point of view.☆15Jan 19, 2022Updated 4 years ago
- Process lines in parallel.☆22Jan 23, 2025Updated last year
- Convert Directories, Files and ZIP Files to Web Archives (WARC)☆102Aug 28, 2026Updated 2 months ago
- An example of multi-select facet with Solr, Vue and Go☆35Mar 11, 2023Updated 3 years ago
- Javascript date parser☆11Dec 8, 2022Updated 3 years ago