bopoda / robots-txt-parserLinks
PHP class for parse all directives from robots.txt files according to specifications
☆47Updated 8 months ago
Alternatives and similar repositories for robots-txt-parser
Users that are interested in robots-txt-parser are comparing it to the libraries listed below
Sorting:
- A PHP library to help extract text out of text documents that are not structured in a processing friendly manner☆46Updated 2 years ago
- An extensible robots.txt parser and client library, with full support for every directive and specification.☆26Updated 4 years ago
- PHP wrapper for the Matomo API.☆95Updated 10 months ago
- PSR-16 simple cache drivers for PHP.☆88Updated 2 years ago
- PHP library to parse URLs from string input☆100Updated 3 months ago
- Native PHP Stemmer☆142Updated last year
- PHP library that extracts/parses meta details of an x/html body, including open graph details, meta tags and images.☆45Updated 6 years ago
- GenPhrase is a secure passphrase generator for PHP applications.☆118Updated 11 months ago
- Php class for robots.txt parse☆85Updated 2 years ago
- Asset Management for PHP☆100Updated 11 months ago
- A fast and reliable PHP library for detecting languages☆131Updated 2 years ago
- Self-updating PHP library which blocks referral spam from ruining your website statistics☆66Updated 5 years ago
- Simple Cache Abstraction Layer for PHP☆32Updated last month
- A meta parser for extracting micro information out of web documents, currently supporting Microformats 1+2, HTML Microdata, RDFa Lite 1.1…☆114Updated 7 months ago
- Build plain text tables with PHP.☆29Updated 3 years ago
- Get gender from first name in PHP.☆55Updated 2 years ago
- Convenient object-oriented operations on strings☆68Updated 3 years ago
- find the size of an image without downloading the whole file. Supports batch requests.☆60Updated 6 years ago
- Geodesy PHP - Port of some known geodesic/math functions for getting distance from a known point A to a known point B given their coordin…☆28Updated 6 years ago
- XML Sitemap parser class compliant with the Sitemaps.org protocol.☆77Updated 3 months ago
- PHP library to manipulate and generate responsive images☆242Updated 4 years ago
- PHP library to work with date and time in different timezones & formats☆142Updated 6 years ago
- Pure-PHP implementation to read and write TAR and ZIP archives☆105Updated 5 months ago
- PHP OEmbed wrapper for well-known video platforms and services☆42Updated 2 years ago
- PHP spell check library☆68Updated last year
- Schema.org library for PHP☆51Updated 4 months ago
- Crawlzone is a fast asynchronous internet crawling framework for PHP.☆82Updated 2 years ago
- ☆79Updated this week
- HtmlMin: HTML Compressor and Minifier via PHP☆176Updated last month
- Internationalization and localization for PHP☆59Updated last year