#
astradb
Here are 2 public repositories matching this topic...
sitemapper is a site mapping tool which provides a JSON output listing each internal URL and the internal links found at that URL. The crawl depth is configurable, as well as the mode of operation: "synchronous", "concurrent" and "concurrent limited". The tool runs stand-alone or as a distributed crawl engine running in a Kubernetes cluster.
-
Updated
Jan 31, 2022 - Go
Improve this page
Add a description, image, and links to the astradb topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the astradb topic, visit your repo's landing page and select "manage topics."