BETAmodules.com is in beta — open to partnerships & joint ventures.Build with us

Home Search Compare Equivalents

One search box and one honest, consistent read on every open-source library — across every ecosystem.

npmPyPIcrates.ioRubyGemsGoMavenNuGet

Discover

Tools

Compare Equivalents

Data

deps.dev OSV advisories npm registry PyPI

About

Methodology Partner with us

© 2026 Modules · A precision instrument for picking dependencies.Data refreshed continuously from public registries, deps.dev & OSV

cross-ecosystem search · live

Results for spider_bot

Found in 3 of 7 ecosystems · 15 matches across other registries

crates.io8 RubyGems2 NuGet5

How we search: free-text on npm, crates.io, RubyGems, NuGet and Maven. PyPI and Go do exact-name lookup only. Tip: click an ecosystem chip below to filter; click Show all ecosystems to come back.

Sort

Auto-load on scroll

crates.io matches

8 matches · Rust

Fast crawler/bot detection from User-Agent strings.

MaintenanceHealthy

PopularityNiche

Maintained. Niche but maintained, actively maintained.

Detect if a user-agent is a known bot

MaintenanceAbandoned

PopularityNiche

Abandoned. Last published 3 years ago.

spider_mcpv2.51.208

MCP (Model Context Protocol) server exposing Spider web crawler capabilities as tools.

MaintenanceHealthy

PopularityNiche

Maintained. Niche but maintained, actively maintained.

spiderv2.51.208

A web crawler and scraper, building blocks for data curation workloads.

MaintenanceHealthy

PopularityNiche

Maintained. Niche but maintained, actively maintained.

spider_skillsv0.1.7

Skills and automation tactics for spider rust projects

MaintenanceHealthy

PopularityNiche

Maintained. Niche but maintained, actively maintained.

arxiv-spiderv0.1.1

A no-API, scrape-based command-line client for arXiv, powered by spider-rs.

MaintenanceHealthy

PopularityNiche

Maintained. Niche but maintained, actively maintained.

texting_robotsv0.2.2

Texting Robots: A Rust native `robots.txt` parser with thorough unit testing.

MaintenanceAbandoned

PopularityNiche

Abandoned. Last published 3 years ago.

spider_cliv2.51.208

The fastest web crawler CLI written in Rust.

MaintenanceHealthy

PopularityNiche

Maintained. Niche but maintained, actively maintained.

RubyGems matches

2 matches · Ruby

spider_botv0.0.5

Spider bot framework

MaintenanceAbandoned

PopularityNiche

Abandoned. Last published 8 years ago.

ssoroka-spider_botv0.9.2

A non-threaded spider bot that spiders a site with response time stats. easily extendable

MaintenanceAbandoned

PopularityNiche

Abandoned. Last published 11 years ago.

NuGet matches

5 matches · .NET

spider.pluginv5.10.0

No description provided.

MaintenanceHealthy

PopularityUnknown

Maintained. Maintained, actively maintained.

skyscraperv1.0.46

No description provided.

MaintenanceAbandoned

PopularityUnknown

Abandoned. Last published 9 years ago.

crawlerlib.engine.testhelperv2.3.5544.21265

No description provided.

MaintenanceAbandoned

PopularityUnknown

Abandoned. Last published 11 years ago.

crawlerlib.enginev2.3.5544.21265

No description provided.

MaintenanceAbandoned

PopularityUnknown

Abandoned. Last published 11 years ago.

No description provided.

MaintenanceAbandoned

PopularityUnknown

Abandoned. Last published 13 years ago.