BETAmodules.com is in beta — open to partnerships & joint ventures.Build with us

crawly

v0.1.9crates.io· Rust

A lightweight async Web crawler in Rust, optimized for concurrent scraping while respecting `robots.txt` rules.

The verdict
Abandoned. Last published over a year ago. No recent activity — look for a maintained alternative.
No recent activity — look for a maintained alternative.
Live from the crates.io registry · derived rules, not AI
How it scores
MaintenanceAbandoned
PopularityNiche
SecurityClean
LicenseOther
DepsZero deps
Maintenance
Last published over a year ago.
Popularity
16 downloads / week
Security
No known advisories for this version (OSV).
License
non-standard
Dependencies
No runtime dependencies
Recent releases
  • 0.1.9over a year ago
  • 0.1.82 years ago
  • 0.1.72 years ago
  • 0.1.62 years ago
  • 0.1.52 years ago
  • 0.1.42 years ago
  • 0.1.32 years ago
  • 0.1.22 years ago
crawly — A lightweight async Web crawler in Rust, optimized for concurrent scraping while respecting `robots.txt` rules. (Rust / crates.io) — verdict, alternatives & security · Modules