Results for robots.txt.parser

Found in 3 of 7 ecosystemsnpm 1–1 of 1 · 9 matches across other registries

How we search: free-text on npm, crates.io, RubyGems, NuGet and Maven. PyPI and Go do exact-name lookup only. Tip: click an ecosystem chip below to filter; click Show all ecosystems to come back.

Sort

Auto-load on scroll

npm matches

1 match · JavaScript

robots-txt-parserv2.0.3

npm

A lightweight robots.txt parser for Node.js with support for wildcards, caching and promises.

Abandoned. Last published 4 years ago.

PyPI matches

Exact match · Python

robots-txt-parserv1.0.1

PyPI

A Robot Exclusion Rules Parser for Python