Revision history for Robots-Validate: v0.3.5 2026-08-25 17:54:33+01:00 Europe/London (TRIAL RELEASE) [Enhancements] - This uses the pure-Perl Algorithm::AhoCorasick module, but will use Algorithm::AhoCorasick::XS if it is available. - Added bad_robot convenience method. - cache_failure can be set in the cache_options as a global default. [Bug Fixes] - Fixed regression: cache_failure overwrote the default expires_in setting. [Documentation] - Added recommended modules to the REQUIREMENTS section of the README. - Fixed POD errors. - Updated SUPPORT section errors. [Tests] - Add tests for pure-Perl modules only. v0.3.4 2026-08-25 14:18:32+01:00 Europe/London (TRIAL RELEASE) [Enhancements] - Added the cache_failure option to invalidate. - This changes the behaviour of caching before v0.3.0. - Added more bots: Cotoyogi, MJ12Bot and SofyaBot. [Documentation] - Added missing items to Changes for v0.3.0. - Updated KNOWN ISSUES. v0.3.3 2026-08-24 19:40:03+01:00 Europe/London (TRIAL RELEASE) [Enhancements] - Updated robot rules. - Added devel/rebuild-robots-config utility to rebuild the robot rules. - Switched the configuration parser to use TOML::Tiny by default, but TOML::XS if it is available. [Documentation] - Improved documentation. [Tests] - Added a missing prerequsite. - Improved tests. v0.3.2 2026-08-23 22:11:38+01:00 Europe/London (TRIAL RELEASE) [Security] - Added missing initial dot to the domain suffixes for petalbot and visionheight, which allowed an imposter domain such as fakepetalsearch.com. [Bug Fixes] - Fixed IPv6 DNS validation. [Documentation] - Removed duplicate CONTRIBUTOR. - Documented why the initial dot for the domain suffix is important. - Improved the SECURITY CONSIDERATIONS section. - Updated automation policy to be "human supervised". - Added link to TOML specification in SEE ALSO. v0.3.1 2026-08-23 01:44:55+01:00 Europe/London (TRIAL RELEASE) [Documentation] - Fixed error in Changes. v0.3.0 2026-08-23 01:36:04+01:00 Europe/London (TRIAL RELEASE) [Incompatible Changes] - This is a complete rewrite, and the interface is not compatible. - Bumped minimum Perl version to v5.24; [Enhancements] - This uses the Aho-Corasick algorithm to match multiple user-agent strings efficiently. - The robot rules are in a configuration file, allowing the user to easily update their own rules. - The robot rules have been expanded and updated. - Support for caching the results has been added, GH#3. [Tests] - Updated the tests to use Test2. [Documentation] - Updated the author email address. - Updated the copyright year. - Added a security policy. [Toolchain] - Use SigStore instead of Module::Signature to sign releases. - Added Automation Policy and DOAP metadata. v0.2.9 2024-01-06 13:48:11+00:00 Europe/London [Incompatible Changes] - Bumped minimum Perl version to v5.14. [Enhancements] - Improved the regex for Slurp to work with Inktomi slurp, not just Yahoo slurp. - Added rule for DataProviderBot. - Added rule for MonsidoBot. - Added rule for Headline ev-crawler. - Removed the starting wordbreak from the regexes, which should improve performance. [Other] - Removed Neevabot rule, since the bot seems to have shut down. [Documentation] - Fixed a typo. - Updated copyright year. v0.2.8 2023-12-13 09:12:44+00:00 Europe/London [Enhancements] - Updated rules for Amazonbot. [Documentation] - Bump copyright year. [Tests] - Switched package used for the release manifest. [Toolchain] - Sign distribution. - Fixed MANIFEST.SKIP rules. v0.2.7 2022-05-12 11:12:06-04:00 EST5EDT [Enhancements] - Added rules for Amazonbot. [Documentation] - Fixed encoding of links in README. [Toolchain] - Remove bad MANIFEST.SKIP rule. v0.2.6 2022-02-12 11:36:55+00:00 Europe/London [Documentation] - Bump copyright year. v0.2.5 2022-02-12 11:28:35+00:00 Europe/London [Enhancements] - Added rules for InfoTiger. [Toolchain] - Removed MANIFEST.SKIP builder due to issues with prerequisites. v0.2.4 2021-06-23 17:11:21+01:00 Europe/London [Enhancements] - Added rules for Coc Coc bot and Qwant. [Documentation] - Add warning about undocumented rules. v0.2.3 2021-06-10 11:30:13+01:00 Europe/London [Enhancements] - Added rules for Neevabot and PetalBot. v0.2.2 2021-05-15 17:13:12+01:00 Europe/London [Enhancements] - Added rules for Archivo.pt and IONOS. v0.2.1 2021-02-06 15:24:22+00:00 Europe/London [Enhancements] - Added rule for Applebot. [Documentation] - Update the copyright year. v0.2.0 2020-10-12 17:50:15+01:00 Europe/London [Enhancements] - Allow validate to take a Plack environment hash. v0.1.6 2019-11-16 11:05:30+00:00 Europe/London [Enhancements] - Added rule for SeznamBot. - Disable strict const attributes unless running in strict mode. [Documentation] - Bump copyright year. v0.1.5 2018-12-06 17:56:02+00:00 Europe/London [Bug Fixes] - Bumped minimum version of Types::Const to support Regexp refs. v0.1.4 2018-12-04 10:42:31+00:00 Europe/London [Other] - Use stricter types for robots attribute. v0.1.3 2018-11-07 00:01:09+00:00 Europe/London [Documentation] - Fix typo in abstract. - Reformat Changes. [Tests] - Added actual tests. [Other] - Remove unused code. - Made query type explicit. v0.1.2 2018-11-06 20:22:07+00:00 Europe/London [Enhancements] - Added rules for Embedly, Exabot, LinkedIn, Mojeek, Naver/Yeti, Pinterest, Sogou spiders. [Documentation] - Fixed typo. - Added note about limitations. [Other] - Sorted robots. v0.1.1 2018-11-05 21:43:45+00:00 Europe/London [Bug Fixes] - Specify a minimum version for List::Util. - Update Yandex verifiction rules. [Documentation] - Document robot verifiction in SEE ALSO section. v0.1.0 2018-11-05 21:29:06+00:00 Europe/London - Initial prototype released.