Super simple website crawler
The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s
Super-minimalist version of `concat-stream`. Less than 15 lines!
Cypress's fork of a simplified HTTP request client.
Compile ES2015 object super to ES5
Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.
RPC-like experience over a regular REST API, with type safe server implementations 🪄
A triple-linked lists based DOM implementation
Super-simple invariant function
Simplified HTTP request client.
Find broken links, missing images, etc in your HTML. Scurry around your site and find all those broken links.
Simple yet powerful framework for building command-line apps.
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
<p align="center"> <img src="https://avatars.githubusercontent.com/u/109956939?s=400&u=8bf67b1281da46d64eab85f48255cd1892bf0885&v=4" height="150"></img> </p>
Nest server integration for @ts-rest
<p align="center"> <img src="https://avatars.githubusercontent.com/u/109956939?s=400&u=8bf67b1281da46d64eab85f48255cd1892bf0885&v=4" height="150"></img> </p>
Better Queue for NodeJS
A super simple node-express web server with https option for when you quickly need to serve some static files. Package includes self-signed certificates. Don't use this for production.
<p align="center"> <img src="https://avatars.githubusercontent.com/u/109956939?s=400&u=8bf67b1281da46d64eab85f48255cd1892bf0885&v=4" height="150"></img> </p>
react-query client integration for @ts-rest
A library to recursively retrieve and serialize Notion pages with customization for machine learning applications.
Simple, EventEmitter API for WebSockets (browser)
HTTP request module customized for crawlers.
This is an ES6 adaptation of the original PHP library CrawlerDetect, this library will help you detect bots/crawlers/spiders vie the useragent.