The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s
A triple-linked lists based DOM implementation
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
A library to recursively retrieve and serialize Notion pages with customization for machine learning applications.
Analyzes license information for multiple node.js modules (package.json files) as part of your software project.
This is an ES6 adaptation of the original PHP library CrawlerDetect, this library will help you detect bots/crawlers/spiders vie the useragent.
Your command center for Claude Code and GitHub Copilot CLI sessions. Watch every session live, send commands, and stop runaway agents, all from a single browser tab.
Used to run a web crawler that checks for errors on specified pages.
Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.
Inspecting Node.js's Network with Chrome DevTools
Argus — AI-powered automated dev-testing platform using Chrome DevTools MCP and Claude Code
Device detection module for Nuxt
Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.
CLI package for Argus.
Privacy-first performance diagnostics for Node.js — Argus
Solidity smart contract security auditing plugin for OpenCode — 6 specialized agents, 16 tools (15 core + optional Solodit), and a curated vulnerability knowledge base
HTTP request module customized for crawlers.
express middleware for serving prerendered javascript-rendered pages for SEO
Ory Argus: the core API for building authentication, authorization, and audit into AI agent harness plugins, extensions, and custom integrations
Argus — Git-native proactive AI agent organization framework CLI.
Argus Vision, a Firefly Tech Labs product. Framework-agnostic browser inspector for mapping UI elements to frontend source context. Works with React, Vue, Svelte, or vanilla JavaScript.
Crawl and download Snap Lenses from *lens.snapchat.com* with ease.
A Twitter crawler helper with auth
TypeScript definitions for crawler