tag

robots.txt parser

72 (<1)
Robots.txt-Parser-Class v0.2.3 — Php class for robots.txt parse
Similar robots.txt parser
7 (<1)
Diggin_RobotRules — PHP parser/handler for Robots Exclusion Protocol (robots.txt and more..)
Similar robots.txt parser
16 (0)
roboxt — simple parser for robots.txt
Similar robots.txt parser

Some additional repos to consider:
10
RobotsTxtParser v2.0.0 — An extensible robots.txt parser and client library, with full support for every directive and specification.
Similar

Once a week...

... I send out a list of most interesting PHP libraries and apps.
Want to get it?