A specification compliant robots.txt parser with wildcard (*) matching support.
Tame the robots crawling and indexing your Nuxt site with ease.
Simple pub/sub messaging for the web
Gatsby plugin that automatically creates robots.txt for your site
Generate a robots.txt for Astro
Express middleware to serve and generate robots.txt
A message bus client in Javascript
generate random IDs and avoid collisions
A simple, accessible, tagging component ready to drop into your React projects.
LiveReload JS client - auto reload browser on changes
TypeScript definitions for hat
A lightweight robots.txt parser for Node.js with support for wildcards, caching and promises.
Validate urls against robots.txt rules.
Get the name of a dependency from a module file path.
Streaming parser for robots.txt files
Convert form parameters to an object using the same logic as Rack
parse arguments with recursive contexts
parse arguments with recursive contexts
TypeScript definitions for react-tag-autocomplete
A reliable robots.txt generator for Astro projects, offering zero-config setup and Verified Bots support.
Vite plugin for generating robots.txt for production and development builds
EasyZoom is an elegant, highly optimised jQuery image zoom and panning plugin based on the original work by Alen Grakalic.
Express middleware for blocking ai-robots
HTML assertions for Chai.
Rack middleware that denies all robots for staging and development environments.
Rack middleware that adds X-Robots-Tag header.
Rack Middleware for detecting robots
Make /robots.txt block all robots
A rack middleware that blocks all bots when BLOCK_ROBOTS environment variable is set to true.
Rack middleware that inserts the X-Robots-Tag into all responses.
A Rack middleware IP filter that uses Http:BL to exclude suspicious robots.
A Rack middleware IP filter that uses Http:BL to exclude suspicious robots.
Little rack middleware to insert '<meta name="robots" content="noindex"></head>' into all HTTPS HTML responses for SEO reasons