Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
Retrieve multiple formats for up to 100 crawled URLs.
scrapfly.getCrawlContentsBatch retrieves selected formats for an explicit URL set in one request.
import { automation, onInvocation } from "automate.ax"
import { scrapfly } from "automate.ax/scrapfly"
export default automation("Read crawl batch", () => {
onInvocation()
scrapfly.getCrawlContentsBatch({
crawlerId: "crawl-id",
urls: ["https://example.com/a", "https://example.com/b"],
formats: ["markdown", "page_metadata"],
})
})
crawlerId, one to 100 urls, and at least one formats entry are required. The supported formats match scrapfly.getCrawlContents. Returns { contents }, keyed first by URL and then by format. Scrapfly omits formats it did not store for a URL.