BETAmodules.com is in beta — open to partnerships & joint ventures.Build with us

cross-ecosystem search · live

Results for web-spider

Found in 3 of 7 ecosystemsnpm 1–24 of 211,762 · 65 matches across other registries

How we search: free-text on npm, crates.io, RubyGems, NuGet and Maven. PyPI and Go do exact-name lookup only. Tip: click an ecosystem chip below to filter; click Show all ecosystems to come back.

Sort

Auto-load on scroll

npm matches

Showing 24 of 211,762 · JavaScript

See all npm →

web-spiderv0.3.1

npm

web-spider is a simple and fast web spider written with Nodejs!

Abandoned. Last published 9 years ago.

huntsmanv0.3.0

npm

Super configurable async web spider

Abandoned. Last published 10 years ago.

@giladbeer/node-spiderv2.0.2

npm

Node.js web spider for site search

Abandoned. Last published 2 years ago.

crawlerv2.1.0

npm

Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.

Maintained. Maintained, actively maintained.

floodeshv0.8.19

npm

Floodesh is a distributed web spider/crawler written with Nodejs.

Abandoned. Last published 6 years ago.

spideyv1.0.7

npm

Robust web spider for Node.js

Abandoned. Last published 3 years ago.

jul11co-sitespiderv0.0.6

Jul11Co Web Spider

Abandoned. Last published 8 years ago.

xlspiderv1.0.6

npm

nodejs's web spider tools

Abandoned. Last published 4 years ago.

anansi-jsv0.0.5

npm

Node.js web spider for site search

Abandoned. Last published 2 years ago.

crawler-hangzhouv1.2.2

npm

A web spider of hangzhou

Abandoned. Last published 8 years ago.

ppspiderv2.2.4-preview.1607350101966

npm

web spider, support puppeteer, cheerio and so on, include task-queue and dispatcher

Abandoned. Last published 5 years ago.

spidarv0.0.2

npm

web spider common tools, targets on chinese sites

Abandoned. Last published 12 years ago.

siphon-webv0.3.1

npm

make up a web spider with a few regular module。

Abandoned. Last published 6 years ago.

A Node.js Web Spider

Abandoned. Last published 11 years ago.

spider-cookiesv1.0.3

npm

Parse and stringify cookies for web spider.

Abandoned. Last published 5 years ago.

web-spider-cliv1.0.0

npm

A concurrent web spider/crawler for downloading web pages recursively with modern TypeScript architecture

Aging — last published 10 months ago — check before adopting.

@arcblock/crawler-middlewarev1.5.3

npm

This express middleware provides pre-rendered HTML generated by SnapKit for Blocklets, enabling them to return complete HTML content to web spider. This is essential for SEO and ensuring that search engines can properly index dynamically generated content

Maintained. Maintained, actively maintained.

frenv0.2.0

npm

easy to build multi-node web spider based on request