Protego

v0.6.0PyPI· Python

Pure-Python robots.txt parser with support for modern conventions

The verdict

Solid choice. Well-adopted and active, actively maintained.

Live from the PyPI registry · derived rules, not AI

How it scores

MaintenanceHealthy

PopularityWidely used

SecurityClean

LicensePermissive

DepsZero deps

Maintenance

Last published 4 months ago.

Popularity

1.6M downloads / week

Security

No known advisories for this version (OSV).

License

BSD-3-Clause

Dependencies

No runtime dependencies

Recent releases