robots.txt parser

16 (0)
roboxt — simple parser for robots.txt
Similar robots.txt parser
8 (0)
Diggin_RobotRules — PHP parser/handler for Robots Exclusion Protocol (robots.txt and more..)
Similar robots.txt parser
69 (<1)
Robots.txt-Parser-Class v0.2.3 — Php class for robots.txt parse
Similar robots.txt parser

Some additional repos to consider:
RobotsTxtParser — An extensible robots.txt parser and client library, with full support for every directive and specification.

Once a week...

... I send out a list of most interesting PHP libraries and apps.
Want to get it?