Package: libwww-robotrules-perl Status: install ok installed Priority: optional Section: perl Installed-Size: 36 Maintainer: Debian Perl Group <pkg-perl-maintainers@lists.alioth.debian.org> [Debian Bug Report] Architecture: all Version: 6.02-1 Replaces: libwww-perl (<< 6.00) Depends: perl, liburi-perl Breaks: libwww-perl (<< 6.00) Description: database of robots.txt-derived permissions WWW::RobotRules parses /robots.txt files as specified in "A Standard for Robot Exclusion", at <http://www.robotstxt.org/wc/norobots.html>. Webmasters can use the /robots.txt file to forbid conforming robots from accessing parts of their web site. The parsed files are kept in a WWW::RobotRules object, and this object provides methods to check if access to a given URL is prohibited. The same WWW::RobotRules object can be used for one or more parsed /robots.txt files on any number of hosts. Homepage: https://metacpan.org/release/WWW-RobotRules Files owned by package libwww-robotrules-perl: /usr /usr/share /usr/share/doc /usr/share/doc/libwww-robotrules-perl /usr/share/doc/libwww-robotrules-perl/changelog.Debian.gz /usr/share/doc/libwww-robotrules-perl/changelog.gz /usr/share/doc/libwww-robotrules-perl/copyright /usr/share/man /usr/share/man/man3 /usr/share/man/man3/WWW::RobotRules.3pm.gz /usr/share/man/man3/WWW::RobotRules::AnyDBM_File.3pm.gz /usr/share/perl5 /usr/share/perl5/WWW /usr/share/perl5/WWW/RobotRules /usr/share/perl5/WWW/RobotRules.pm /usr/share/perl5/WWW/RobotRules/AnyDBM_File.pm