Pure data types and constants for spider_agent automation. Zero heavy dependencies.
Skills and automation tactics for spider rust projects
A no-API, scrape-based command-line client for arXiv, powered by spider-rs.
An async web crawling framework for Rust - Scrapy for Rust
Middleware implementations for the spider-lib web scraping framework.
A web crawler and scraper, building blocks for data curation workloads.
Browser automation client for Spider's pre-warmed browser fleet with smart retry and browser switching
Async-first web scraping framework (Rust port)
A high-performance, concurrent web scraping framework for Rust with built-in support for retries, storage backends, and concurrent request handling
A Rust-based web scraping framework inspired by Scrapy (Python).
Local AI coding CLI for inspecting, editing, running commands, and auditing repositories