This module is propose to scrapy website pages and extract information from doms which selected by jQuery-like selectors
A command-line tool acting as an MCP (ModelContextProtocol) server, using Playwright to crawl web content for AI models.
The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s
A triple-linked lists based DOM implementation
smart-buffer is a Buffer wrapper that adds automatic read & write offset tracking, string operations, data insertions, and more.
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
A command-line tool acting as an MCP (ModelContextProtocol) server, using Playwright to crawl web content for AI models.
A library to recursively retrieve and serialize Notion pages with customization for machine learning applications.
This is an ES6 adaptation of the original PHP library CrawlerDetect, this library will help you detect bots/crawlers/spiders vie the useragent.
Analyzes license information for multiple node.js modules (package.json files) as part of your software project.
通用智能爬虫n8n节点，使用Axios + Cheerio，支持多跳数据提取
Used to run a web crawler that checks for errors on specified pages.
Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.
Inspecting Node.js's Network with Chrome DevTools
The Nx Devkit is used to customize Nx for different technologies and use cases. It contains many utility functions for reading and writing files, updating configuration, working with Abstract Syntax Trees(ASTs), and more. Learn more about [extending Nx by
Device detection module for Nuxt
Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.
CLI for generating code and running commands
The core Nx plugin contains the core functionality of Nx like the project graph, nx commands and task orchestration.
The Nx Devkit is used to customize Nx for different technologies and use cases. It contains many utility functions for reading and writing files, updating configuration, working with Abstract Syntax Trees(ASTs), and more. Learn more about [extending Nx by
The JS plugin for Nx contains executors and generators that provide the best experience for developing JavaScript and TypeScript projects.
The Workspace plugin contains executors and generators that are useful for any Nx workspace. It should be present in every Nx workspace and other plugins build on it.
The Workspace plugin contains executors and generators that are useful for any Nx workspace. It should be present in every Nx workspace and other plugins build on it.
The Nx Plugin for Web Components contains generators for managing Web Component applications and libraries within an Nx workspace. It provides: - Integration with libraries such as Jest, Playwright, Cypress, and Storybook. - Scaffolding for creating bu