Paket: libwww-robotrules-perl (6.02-1)

Länkar för libwww-robotrules-perl

Debianresurser:

Hämta källkodspaketet libwww-robotrules-perl:

Ansvariga:

Externa resurser:

Hemsida [metacpan.org]

Liknande paket:

database of robots.txt-derived permissions

WWW::RobotRules parses /robots.txt files as specified in "A Standard for Robot Exclusion", at <http://www.robotstxt.org/wc/norobots.html>. Webmasters can use the /robots.txt file to forbid conforming robots from accessing parts of their web site.

The parsed files are kept in a WWW::RobotRules object, and this object provides methods to check if access to a given URL is prohibited. The same WWW::RobotRules object can be used for one or more parsed /robots.txt files on any number of hosts.

Märken: Software Development: Perl Development, Bibliotek, Implemented in: Perl, Role: Shared Library

Andra paket besläktade med libwww-robotrules-perl

beror

rekommenderar

föreslår

enhances

dep: liburi-perl

module to manipulate and access URI strings
dep: perl

Larry Wall's Practical Extraction and Report Language

Hämta libwww-robotrules-perl

Hämtningar för alla tillgängliga arkitekturer
Arkitektur	Paketstorlek	Installerad storlek	Filer
all	12,6 kbyte	36,0 kbyte	[filförteckning]