A way to make your web application crawlable, so it can be well referenced on the web.
crawlable-todos ===============
Some tools to help you to render your application as a static web site using the crawlable module.
Automatically extract semantic content from rendered UI and inject it back as crawlable, SEO-safe markup
Make your site crawlable by AI agents in minutes
Fake server that produces the specified amount of pages in directories to test web crawlers
Node.js app for taking HTML snapshots of JavaScript pages to make your dynamic apps Google crawlable.
No description provided.
jQuery Address - Deep linking for the masses
ExpressJS Middleware for AjaxSnapshots
A selector-based html snapshot tool using Puppeteer or PhantomJS that sources sitemap.xml, robots.txt, or arbitrary input
Extract Resources scenario is used for extracting various resources from the corresponding sites.
Instant AI-Powered SEO Optimization CLI for Developers
Fast, graceful, JS-based page loading without going full SPA
Web application building blocks.
High-performance PDF to HTML converter — MuPDF via Rust/napi-rs, Node.js bindings
A tiny, fast, zero-dependency reactive UI framework for the browser
MCP server for performing PageSpeed Audits
Makes your ajax web application indexable by search engines by generating html snapshots on the fly. Caches results for blazing fast responses and better page ranking.
Add internationalization support NextJS SSG ( next export )
A package for detecting keywords on the Internet Computer
Instant setup CLI for React Prerender DataCops
Crawl-based SEO audit CLI with JS rendering, JSON-LD validation, CrUX field data, sitemap walking, HTML/PDF reports, and crawl diffing.
Crawls a site, extracts the links and returns the promise of either a sitemap or just a list of links.
Beacon Atlas relay client for AI agent registration, heartbeat, and SEO-enhanced discoverability
SFX is a streamlined, full-stack Rust framework for building small web services with integrated authentication, localization, and config-driven UI components
Super DRY Sitemaps for Rails and Sinatra Apps
Ember Seo helps you make you Ember app crawlable by Google.
SEO.js makes your BackboneJS, AngularJS or EmberJS apps crawlable by Google to make them appear in search results.