A specification compliant robots.txt parser with wildcard (*) matching support.
Tame the robots crawling and indexing your Nuxt site with ease.
Gatsby plugin that automatically creates robots.txt for your site
Generate a robots.txt for Astro
Express middleware to serve and generate robots.txt
A simple, accessible, tagging component ready to drop into your React projects.
A lightweight robots.txt parser for Node.js with support for wildcards, caching and promises.
Validate urls against robots.txt rules.
Your command center for Claude Code and GitHub Copilot CLI sessions. Watch every session live, send commands, and stop runaway agents, all from a single browser tab.
Get the name of a dependency from a module file path.
Streaming parser for robots.txt files
Argus — AI-powered automated dev-testing platform using Chrome DevTools MCP and Claude Code
parse arguments with recursive contexts
CLI package for Argus.
Privacy-first performance diagnostics for Node.js — Argus
Solidity smart contract security auditing plugin for OpenCode — 6 specialized agents, 16 tools (15 core + optional Solodit), and a curated vulnerability knowledge base
parse arguments with recursive contexts
TypeScript definitions for react-tag-autocomplete
A reliable robots.txt generator for Astro projects, offering zero-config setup and Verified Bots support.
Vite plugin for generating robots.txt for production and development builds
Ory Argus: the core API for building authentication, authorization, and audit into AI agent harness plugins, extensions, and custom integrations
EasyZoom is an elegant, highly optimised jQuery image zoom and panning plugin based on the original work by Alen Grakalic.
Argus — Git-native proactive AI agent organization framework CLI.
Express middleware for blocking ai-robots
Robots.txt parsing and caching for web crawling
Common types and utilities for the Argus web crawler
Configuration management for the Argus web crawler
A production-ready web crawler capable of handling billions of URLs
Content deduplication utilities for web crawling
HTTP fetching utilities with retry logic for web crawling
URL frontier implementations for web crawling
HTML and sitemap parsing utilities for web crawling
Storage backends for crawled web data
Worker implementation for distributed web crawling