HTML processing utilities for spider_agent — cleaning, content analysis, and diffing.
A concurrent-safe multimodal agent for web automation and research.
A no-API, scrape-based command-line client for arXiv, powered by spider-rs.
Pure data types and constants for spider_agent automation. Zero heavy dependencies.
Skills and automation tactics for spider rust projects
Async-first web scraping framework (Rust port)
A web crawler and scraper, building blocks for data curation workloads.
Browser automation client for Spider's pre-warmed browser fleet with smart retry and browser switching
A Rust-based web scraping framework inspired by Scrapy (Python).
The fastest web crawler CLI written in Rust.
Async Rust client for the KLIPY API
A high-performance, concurrent web scraping framework for Rust with built-in support for retries, storage backends, and concurrent request handling