Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
Read paginated or single-page content from a Scrapfly crawl.
scrapfly.getCrawlContents reads one content format from a crawl.
import { automation, onInvocation } from "automate.ax"
import { scrapfly } from "automate.ax/scrapfly"
export default automation("Read crawled Markdown", () => {
onInvocation()
scrapfly.getCrawlContents({
crawlerId: "crawl-id",
format: "markdown",
limit: 50,
})
})
crawlerId and format are required. Formats are html, clean_html, markdown, text, json, extracted_data, and page_metadata. Map mode accepts limit (1–50) and offset; it returns { mode: "map", contents, links }. Plain mode requires both plain: true and one url; it returns { mode: "plain", content }.