A concurrent-safe multimodal agent for web automation and research.
Pure data types and constants for spider_agent automation. Zero heavy dependencies.
HTML processing utilities for spider_agent — cleaning, content analysis, and diffing.
Fast crawler/bot detection from User-Agent strings.
Skills and automation tactics for spider rust projects
Detect if a user-agent is a known bot
Randomly generate common userAgents,used by spider
A web crawler and scraper, building blocks for data curation workloads.
gRPC tokio based web crawler built with spider
A no-API, scrape-based command-line client for arXiv, powered by spider-rs.
Middleware implementations for the spider-lib web scraping framework.
Browser automation client for Spider's pre-warmed browser fleet with smart retry and browser switching
No description provided.
No description provided.
No description provided.
No description provided.