Parser for XML Sitemaps to be used with Robots.txt and web crawlers
A command-line wrapper around [`sitemapper`](https://www.npmjs.com/package/sitemapper).
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
A Model Context Protocol (MCP) tool that extracts URLs from sitemap.xml files using the sitemapper library. Provides functionality to fetch and parse sitemap URLs with configurable limits for efficient URL extraction.
Sitemapper + Lighthouse => LightMapper [get sitemap then scan all page].
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
## Install
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers. (Extended version by mastixmc)
A lightweight sitemap crawler for Node.js
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
Parser for XML Sitemaps to be used with Robots.txt and web crawlers
sitemap.xml generation in node.js.
Site mapper utilizing puppeteer to generate a xml sitemap
Sitemapper helps you to apply SEO techniques on your Ruby on Rails application, including auto generation of a sitemap.
Faciliates generating static sitemap XML files from ActiveRecord
Create a sitemap with a data collection
It starts from the arbitrary page you provide and descents into the tree of links until it has either traversed all possible content on the web site or has stopped at some predefined traversal depth. It is written in Ruby and implemented as a CLI application. Based on user preference, it can output text reports in a standard sitemap.xml form (used by many search engines), a dot file (for easier site hierarchy visualization, graphviz compatible), a plain text file (displaying detailed hierarchical relations between pages) and a simple HTML format.
Sitemapper helps you to apply SEO techniques on your Ruby on Rails application, including auto generation of a sitemap.