Constant-frequency recursive CLI web scraper with frequency, filtering, file directory, and many other options for scraping HTML, images and other files.
Web scraper for Crabs
Web scraper for Crabs - tokio version
Macros implementation of #[derive(Scraper)]
The core framework xpath parsing
A magic html parser
HTML manipulation with CSS seletors
HTML manipulation with CSS seletors
HTML manipulation with CSS seletors
QuickCrawler is a Rust crate that provides a completely async, declarative web crawler with domain-specific request rate-limiting built-in.
A URL Crawler tool and library for crawling web targets, discovering links, and detecting secrets with configurable regex rules.
A high-performance, concurrent web scraping framework for Rust with built-in support for retries, storage backends, and concurrent request handling