BETAmodules.com is in beta — open to partnerships & joint ventures.Build with us

Home Search Compare Equivalents

One search box and one honest, consistent read on every open-source library — across every ecosystem.

npmPyPIcrates.ioRubyGemsGoMavenNuGet

Discover

Tools

Compare Equivalents

Data

deps.dev OSV advisories npm registry PyPI

About

Methodology Partner with us

© 2026 Modules · A precision instrument for picking dependencies.Data refreshed continuously from public registries, deps.dev & OSV

cross-ecosystem search · live

Results for website_crawler

Found in 3 of 7 ecosystemsnpm 1–1 of 1 · 83 matches across other registries

npm1 crates.io76 NuGet7

How we search: free-text on npm, crates.io, RubyGems, NuGet and Maven. PyPI and Go do exact-name lookup only. Tip: click an ecosystem chip below to filter; click Show all ecosystems to come back.

Sort

Auto-load on scroll

npm matches

1 match · JavaScript

@a11ywatch/crawlerv0.9.9

gRPC tokio based web crawler

MaintenanceAbandoned

PopularityUnknown

Abandoned. Last published over a year ago.

crates.io matches

Showing 12 of 76 · Rust

See all crates.io →

website_crawlerv0.9.9

gRPC tokio based web crawler built with spider

MaintenanceAbandoned

PopularityNiche

Abandoned. Last published over a year ago.

website_crawler_sdkv1.0.0

The official Rust SDK for the Website Crawler API

MaintenanceHealthy

PopularityNiche

Maintained. Niche but maintained, actively maintained.

siteone-crawlerv2.3.0

Website crawler and QA toolkit in Rust for security, performance, SEO, and accessibility audits, offline cloning, markdown export, sitemap generation, cache warming, and CI/CD gating — one dependency-free binary for all major platforms, 10 tools in one.

MaintenanceHealthy

PopularityNiche

Maintained. Niche but maintained, actively maintained.

WikiFeet (The collaborative celebrity feet website) crawler

MaintenanceAbandoned

PopularityNiche

Abandoned. Last published 4 years ago.

web-crawlerv0.1.3

Finds every page, image, and script on a website (and downloads it)

MaintenanceAbandoned

PopularityNiche

Abandoned. Last published over a year ago.

Linter for Postgresql focused on database migrations.

MaintenanceHealthy

PopularityNiche

Maintained. Niche but maintained, actively maintained.

native-port-crawlerv0.1.0-alpha.2

Rendered-site crawler and snapshot collector for native-first website ports.

MaintenanceHealthy

PopularityNiche

Maintained. Niche but maintained, actively maintained.

spider-clientv0.1.87

Spider Cloud client

MaintenanceHealthy

PopularityNiche

Maintained. Niche but maintained, actively maintained.

Trainable, modular AI engine in Rust with compile-time knowledge

MaintenanceHealthy

PopularityNiche

Maintained. Niche but maintained, actively maintained.

Web spiders to scrap various man{ga,hua;hwa}s websites

MaintenanceAbandoned

PopularityNiche

Abandoned. Last published 5 years ago.

tree-sitter-robots-txtv1.0.1

Grammar for robots.txt

MaintenanceHealthy

PopularityNiche

Maintained. Niche but maintained, actively maintained.

spiderv2.51.208

A web crawler and scraper, building blocks for data curation workloads.

MaintenanceHealthy

PopularityNiche

Maintained. Niche but maintained, actively maintained.

NuGet matches

7 matches · .NET

fiftyone.devicedetection.cloudv4.5.103

No description provided.

MaintenanceHealthy

PopularityUnknown

Maintained. Maintained, actively maintained.

fiftyone.devicedetection.sharedv4.5.103

No description provided.

MaintenanceHealthy

PopularityUnknown

Maintained. Maintained, actively maintained.

fiftyone.devicedetectionv4.5.103

No description provided.

MaintenanceHealthy

PopularityUnknown

Maintained. Maintained, actively maintained.

fiftyone.devicedetection.hash.engine.onpremisev4.5.103

No description provided.

MaintenanceHealthy

PopularityUnknown

Maintained. Maintained, actively maintained.

webcrawlerapiv1.0.2

No description provided.

MaintenanceAging

PopularityUnknown

Aging — last published over a year ago — check before adopting.

totalrecallv0.2.3

No description provided.

MaintenanceAbandoned

PopularityUnknown

Abandoned. Last published 14 years ago.

No description provided.

MaintenanceAbandoned

PopularityUnknown

Abandoned. Last published 4 years ago.