API definition, resources and reference implementation of URL Frontiers
☆64Jul 30, 2026Updated last week
Alternatives and similar repositories for url-frontier
Users that are interested in url-frontier are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A set of reusable Java components that implement functionality common to any web crawler☆257Jul 27, 2026Updated 2 weeks ago
- A scalable, mature and versatile web crawler based on Apache Storm☆992Updated this week
- Code and Data of the paper: "Redefining Retrieval Evaluation in the Era of LLMs"☆16Oct 27, 2025Updated 9 months ago
- Internet Archive's Sparkling Data Processing Library☆17May 4, 2026Updated 3 months ago
- Java implementation of the Internet Research Lab Web Crawler (IRLbot) as presented by Hsin-Tsang Lee, Derek Leonard, Xiaoming Wang, and D…☆17May 25, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Download GitHub repositories☆13May 10, 2025Updated last year
- An evil web server.☆13May 9, 2015Updated 11 years ago
- A simple Rust library to retrieve data from https://api.carbonintensity.org.uk/☆11Apr 25, 2026Updated 3 months ago
- Add editing UI and other power-user features to Datasette.☆14Mar 4, 2023Updated 3 years ago
- demos using the OpenRNDR framework☆13Mar 27, 2020Updated 6 years ago
- A Text Classification API in Java originally developed by DigitalPebble Ltd. The API is independent from the ML implementations used and …☆48Sep 24, 2021Updated 4 years ago
- Original GOKb repo - Moving to https://github.com/openlibraryenvironment/gokb☆11Jan 23, 2018Updated 8 years ago
- INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retrieval. Includes BPR and JPQ.☆24Sep 24, 2023Updated 2 years ago
- Trough: Big data, small databases.☆43Jul 25, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- visualizations/charts for media collections, based on mediainfo☆14Sep 15, 2022Updated 3 years ago
- [LG유플러스 합격, 유명 블로그 글 발행] 지역 사람들과 공감할 수 있는 지도 기반 블로깅 서비스☆12Feb 15, 2022Updated 4 years ago
- MftReader is a Command-Line interface (CLI) program which reads the Master File Table (MFT) from NTFS volume. (C# Implementation with PIn…☆14Sep 13, 2018Updated 7 years ago
- A Maven plugin for inspecting, decompiling, and instrumenting Java jar dependencies☆22Mar 27, 2026Updated 4 months ago
- Implementation of "Matryoshka-Adaptor: Unsupervised and Supervised Tuning for Smaller Embedding Dimensions"☆25Aug 27, 2024Updated last year
- Hadoop-based tool for extraction of large scale synchronous grammars for paraphrasing and machine translation☆15Dec 2, 2016Updated 9 years ago
- Tools for preservation of floppy disks☆15Mar 25, 2026Updated 4 months ago
- Go OCFL Implementation☆18Jun 24, 2026Updated last month
- The geometry of multilingual language model representations (EMNLP 2022).☆22Oct 21, 2022Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Hadoop integration code for working with with Apache cTAKES☆10Feb 11, 2014Updated 12 years ago
- ifcParserLib is a set of reusable Java components that implement functionality for IFC file parsing.☆10Oct 14, 2020Updated 5 years ago
- Solr Datasource for Grafana☆22Aug 24, 2023Updated 2 years ago
- A utility for staging files, calculating and validating file checksums, and comparing checksum values between storage locations.☆14Jul 10, 2023Updated 3 years ago
- Contextually-aware notebooks with built-in AI assistant☆21Jul 30, 2026Updated last week
- Docker container for ocropus3 OCR system☆13Aug 19, 2018Updated 7 years ago
- Solr and LucidWorks search user interface☆16Apr 29, 2013Updated 13 years ago
- Omeka-S in Docker containers.☆20Jan 18, 2022Updated 4 years ago
- Apache Pony Mail☆15Jul 29, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Declarative syntax for defining sets of URLs. No need for error-prone regexs.☆21Apr 24, 2019Updated 7 years ago
- Specification for a query language to request Verifiable Presentations from wallets etc.☆10Apr 23, 2026Updated 3 months ago
- golang readers for ARC and WARC webarchive formats☆20Apr 3, 2023Updated 3 years ago
- code and data used to build a training dataset for dragnet models☆10Nov 29, 2020Updated 5 years ago
- Open-Source Information Retrieval Reproducibility Challenge☆51Jan 11, 2016Updated 10 years ago
- Citadel: Enterprise Search☆15May 2, 2023Updated 3 years ago
- An HTTP Proxy that archives all intercepted traffic.☆21Aug 26, 2014Updated 11 years ago