Universal agnostic web crawler with Claude-powered CSS selector discovery
Configuration and site profile types for dig2crawl
Core types and traits for dig2crawl