Discover a website's URLs (for page selection)
Knowledgebases
Discover a website's URLs (for page selection)
Synchronously maps a site (sitemap + link graph) and returns the discovered URLs so the caller can pick which pages to ingest. Does not scrape content.
POST
Discover a website's URLs (for page selection)
