chrisakroyd/robots-txt-parser external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

chrisakroyd/robots-txt-parser

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/chrisakroyd/robots-txt-parser)

Close

chrisakroyd / robots-txt-parserView on GitHubMore

• External links
• Readme badge

A lightweight robots.txt parser for Node.js with support for wildcards, caching and promises.

☆15Jun 23, 2023Updated 2 years ago

Alternatives and similar repositories for robots-txt-parser

Users that are interested in robots-txt-parser are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• Xiphe / remix-polyglot

  View on GitHub
  type-safe, cached-forever, split-able, non-flickering, pre-loading, persistence-agnostic internationalization made for remix ♥
  ☆11Feb 6, 2023Updated 3 years ago
• SilentByte / litecache

  View on GitHub
  A lightweight, easy-to-use, and straightforward caching library for PHP.
  ☆10Jan 10, 2021Updated 5 years ago
• dinogit / tanstack-table-builder

  View on GitHub
  ☆14Aug 28, 2025Updated 6 months ago
• yiisoft / translator-formatter-intl

  View on GitHub
  Yii i18n intl message formatter
  ☆10Nov 8, 2022Updated 3 years ago
• yiisoft / log-target-syslog

  View on GitHub
  Yii Logging Library - Syslog Target
  ☆10Jan 28, 2026Updated last month
• yiisoft / translator-message-gettext

  View on GitHub
  Yii i18n gettext message storage
  ☆13Dec 30, 2025Updated 2 months ago
• yiisoft / yii-runner

  View on GitHub
  Yii application runner
  ☆16Dec 19, 2025Updated 3 months ago
• jacob-ebey / remix-flags

  View on GitHub
  Eventually* Everything you'll need for successful feature flagging
  ☆17Jun 18, 2022Updated 3 years ago
• yiisoft / definitions

  View on GitHub
  The package provides definition syntax. Definition is describing a way to create and configure a service or an object.
  ☆15Jan 30, 2026Updated last month
• szepeviktor / WordPress-the-good-parts

  View on GitHub
  A sustainable and modernized version of WordPress core.
  ☆13Feb 8, 2023Updated 3 years ago
• hiqdev / yii2-module-pages

  View on GitHub
  Yii2 Pages Module
  ☆11Mar 26, 2021Updated 4 years ago
• yiisoft / data-db

  View on GitHub
  Database adapter for data interfaces
  ☆14Dec 13, 2025Updated 3 months ago
• yiisoft / translator-message-php

  View on GitHub
  Yii i18n PHP message storage
  ☆14Dec 6, 2025Updated 3 months ago
• SkyzohKey / react-native-apk

  View on GitHub
  A react-native library to get various informations about an Android app.
  ☆20Aug 27, 2019Updated 6 years ago
• sergiodxa / api-client

  View on GitHub
  A strongly typed API client using Zod
  ☆15Dec 4, 2023Updated 2 years ago
• kornelski / hCardValidator

  View on GitHub
  hCard Microformat Validator
  ☆17Feb 1, 2017Updated 9 years ago
• platformatic / watt-next-laravel

  View on GitHub
  A demo of Laravel running via the @platformatic/php stackable.
  ☆23Nov 10, 2025Updated 4 months ago
• ionic-team / stencil-dev-server

  View on GitHub
  DEPRECATED: Stencil Development Server
  ☆11Jul 10, 2018Updated 7 years ago
• adrienv1520 / bitgener

  View on GitHub
  A lightweight and zero-dependencies pure Node.js barcode generator.
  ☆13Jul 18, 2023Updated 2 years ago
• yiisoft / cache-file

  View on GitHub
  Yii Cache Library - File Handler
  ☆13Jan 30, 2026Updated last month
• selimachour / xdviewer

  View on GitHub
  A javascript Adobe XD viewer
  ☆12May 29, 2025Updated 9 months ago
• bedis-elacheche / self-driving-car

  View on GitHub
  A javascript simulation in which cars learn to navigate themselves through a track.
  ☆14Jun 24, 2021Updated 4 years ago
• yiisoft / cache-memcached

  View on GitHub
  Yii Cache Library - Memcached Handler
  ☆13Jan 30, 2026Updated last month
• johannschopplich / unacl

  View on GitHub
  🙅‍♀️🙆‍♂️ Minimal, type-safe and reactive access control
  ☆12Apr 18, 2023Updated 2 years ago
• azjezz / web-php-mock-ups

  View on GitHub
  Mock ups for the new PHP Project website proposal
  ☆16Feb 6, 2019Updated 7 years ago
• jacob-ebey / remix-rsc-do-not-use

  View on GitHub
  ☆18May 16, 2023Updated 2 years ago
• yiisoft / rbac-db

  View on GitHub
  yiisoft/db adapter for RBAC.
  ☆18Dec 19, 2025Updated 3 months ago
• yiisoft / log-target-email

  View on GitHub
  Yii Logging Library - Email Target
  ☆14Jan 28, 2026Updated last month
• kiliman / express-auth-example

  View on GitHub
  ☆14Feb 13, 2022Updated 4 years ago
• yiisoft / cache-db

  View on GitHub
  Yiisoft database adapter for cache
  ☆13Feb 1, 2026Updated last month
• umpirsky / Gravatar

  View on GitHub
  Lightweight Gravatar library.
  ☆17Mar 12, 2016Updated 10 years ago
• keylase / ndi

  View on GitHub
  ☆18Jan 8, 2018Updated 8 years ago
• kitze / tired-of-webdev

  View on GitHub
  ☆28Dec 7, 2022Updated 3 years ago
• cgutteridge / Graphite

  View on GitHub
  PHP RDF Library
  ☆48Nov 4, 2018Updated 7 years ago
• bhushan / pingping

  View on GitHub
  Easily Integrate PingPing APIs in your Laravel Project
  ☆15May 2, 2021Updated 4 years ago
• yiisoft / cache-wincache

  View on GitHub
  Yii Cache Library - WinCache Handler
  ☆17Jan 30, 2026Updated last month
• percolate / retry

  View on GitHub
  Percolate's Go retry package
  ☆11Mar 16, 2023Updated 3 years ago
• ahalimkara / babel-plugin-import-static-files

  View on GitHub
  Transforms static files import and copy files to /static folder for next.js applications
  ☆16Jan 16, 2018Updated 8 years ago
• mcansh / http-helmet

  View on GitHub
  easily add CSP and other security headers to your web application.
  ☆23Jun 13, 2025Updated 9 months ago