The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s
A triple-linked lists based DOM implementation
This is a copy of the logstashUDP appender but instead sending via UDP send via TCP to avoid the maximum 64k bytes message size with the logstashUDP appender.
General logstash client with multiple transport support
A Logstash transport for winston
An mutable object-based log format designed for chaining & objectMode streams.
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
Logstash HTTP Appender for log4js-node
A winston@3 replacement for both winston-logstash and winston-logstash-udp to facilitate either TCP or UDP traffic to logstash
A library to recursively retrieve and serialize Notion pages with customization for machine learning applications.
Logstash TCP plugin for Bunyan
This is an ES6 adaptation of the original PHP library CrawlerDetect, this library will help you detect bots/crawlers/spiders vie the useragent.
Analyzes license information for multiple node.js modules (package.json files) as part of your software project.
Simple log generator for testing kibana
Used to run a web crawler that checks for errors on specified pages.
An Elasticsearch transport for winston
Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.
Inspecting Node.js's Network with Chrome DevTools
Device detection module for Nuxt
Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.
Resolve a URI relative to an optional base URI
Logstash UDP Appender for log4js-node
winston-logstash-transport
A Logstash UDP transport for winston