Core scraping engine for Halldyll - high-performance async web scraper for AI agents
A web crawler framework for Rust
A simple gem for scrapping links within an assigned website. Results for domain, external links, and invalid URLs can be saved as CSVs or returned as a hash.