A no-API, scrape-based command-line client for arXiv, powered by spider-rs.
A web crawler and scraper, building blocks for data curation workloads.
A tool for web search on your favorite sites.
基于微信公众号后台超链接查找的文章爬虫 CLI
A Rust-based web scraping framework inspired by Scrapy (Python).
Firewall to use for Spider Web Crawler.
gottem adapter that dispatches through spider::Website for full local power (T0-T3).
PKU 命令行工具集 — 树洞、教学网、校园卡、选课、爬虫一站式安装
Detect if a user-agent is a known bot
A high-performance, concurrent web scraping framework for Rust with built-in support for retries, storage backends, and concurrent request handling
Rust Web Crawler
Web crawler network blocking urls and patterns.