BETAmodules.com is in beta — open to partnerships & joint ventures.Build with us
modules.com
⌘K

simplecrawler

v0.1.8RubyGems· Ruby

The SimpleCrawler module is a library for crawling web sites. The crawler provides comprehensive data from the page crawled which can be used for page analysis, indexing, accessibility checks etc. Restrictions can be specified to limit crawling of binary files.

The verdict
Abandoned. Last published 14 years ago. No recent activity — look for a maintained alternative.
No recent activity — look for a maintained alternative.
Live from the RubyGems registry · derived rules, not AI
How it scores
MaintenanceAbandoned
PopularityNiche
SecurityClean
LicenseUnknown
DepsZero deps
Maintenance
Last published 14 years ago.
Popularity
6 downloads / week
Security
No known advisories for this version (OSV).
License
No license declared.
Dependencies
No runtime dependencies
Recent releases
  • 0.1.814 years ago
  • 0.1.016 years ago
  • 0.1.116 years ago
  • 0.1.316 years ago
  • 0.1.416 years ago
  • 0.1.616 years ago
  • 0.1.716 years ago
simplecrawler — The SimpleCrawler module is a library for crawling web sites. The crawler provides comprehensive data from the page crawled which can be used for page analysis, indexing, accessibility checks etc. Restrictions can be specified to limit crawling of binary files. (Ruby / RubyGems) · Modules