Spacetrim is trimming string from all 4 sides.
TypeScript SDK for EventCrawler v2 API - News and event aggregation with AI analysis
NodeJS HTTP Client Middleware Libraries for SnapSearch. Search engine optimisation for single page applications.
Angular2 using ES2016 instead of TypeScript
A lazy, fluent web crawler with an async/await API.
Julian Hecker's personal template for starting React projects
Sober learns to set up a simple cli tool
Identify technology on websites - Wappalyzer npm module based on HTTP Archive fork.
A Star Wars Crawl Text Opening made by react native
See what IPs are hitting your website the most in real time. (Great for catching spambots and poorly behaved web crawlers)
basic web crawler
Decorator-friendly edge node SDK for the distributed gateway system
web crawler just for links
Grabs Open Graph and Twitter Card metadata out of an HTML page
IndexBoost Render middleware for Node.js (Express, Koa, Hapi, Fastify)
PACKAGE_DESCRIPTION
Crawler for Warsaw Stock Exchange (GPW) and NewConnect getting all listed companies
AISY：An intelligent AI-powered search engine that breaks down complex queries into sub-questions
The Pirate Bay crawler for Node.js
A concurrent web spider/crawler for downloading web pages recursively with modern TypeScript architecture
Node.js YouTube crawler without API key usage
OwnSurface CLI — See through any website. Security scanner, tech stack detection, and offensive testing from your terminal.
Configurable URL discovery and processing pipeline library with built-in content handling, retention-aware sharded JSON persistence, hookable context stages, and pluggable selector logic.
Crawls a website and lists or downloads all resources