Scrape URL with Scrapfly

scrapfly.scrapeUrl retrieves one URL through Scrapfly. Use it when you need the response body plus request, proxy, cost, cache, screenshot, and monitoring details.

import { automation, onSchedule } from "automate.ax"
import { scrapfly } from "automate.ax/scrapfly"

export default automation("Read release notes", () => {
  onSchedule({ schedule: "0 7 * * *" })
  scrapfly.scrapeUrl({
    url: "https://example.com/releases",
    format: "markdown",
    renderJs: true,
    asp: true,
  })
})

Inputs accept literal values or compatible signals. Pass { account } as the optional second argument to select a named Scrapfly binding.

Input	Type	Required	Default	Description
`url`	`string`	Yes	—	Complete target URL.
`format`	`'json' \| 'text' \| 'markdown' \| 'clean_html' \| 'raw'`	No	Scrapfly default	Response representation.
`method`, `body`, `headers`, `cookies`	Request controls	No	GET, no body	Configure the upstream request.
`renderJs`, `renderingStage`, `renderingWait`, `waitForSelector`, `javascript`, `javascriptScenario`, `autoScroll`	Browser controls	No	Provider defaults	Render or interact with the page before capture.
`asp`, `country`, `proxyPool`, `session`, `sessionStickyProxy`, `browserBrand`, `os`, `languages`, `geolocation`	Network controls	No	Provider defaults	Configure Scrapfly’s proxy and anti-bot behavior.
`cache`, `cacheClear`, `cacheTtl`	Cache controls	No	Provider defaults	Reuse, evict, or set the lifetime of a matching result.
`extractionPrompt`, `extractionModel`, `extractionTemplate`	Extraction controls	No	None	Ask Scrapfly to extract data during the scrape.
`screenshots`, `screenshotFlags`	Screenshot controls	No	None	Capture named full-page, CSS, or XPath screenshots.
`formatOptions`, `raiseOnUpstreamError`, `costBudget`, `timeout`, `tags`, `correlationId`, `webhookName`, `dns`, `ssl`	Advanced controls	No	Provider defaults	Apply output filters, limits, monitoring metadata, webhook delivery, or diagnostics.

The result contains content, data?, response status and headers, timing, cache, cost, proxy context, screenshots, Scrapfly log URL, and request UUID. This action rejects Scrapfly’s raw proxified-response mode because native Response values are not durable automation outputs.

Built-in triggers

Built-in actions

Runtime utilities

Integrations

Scrape URL with Scrapfly