Skip to content

Scrape Request Fields

POST https://api.firecrawl.dev/v2/scrape

Headers:

  • Authorization: Bearer <token>
  • Content-Type: application/json
FieldTypeRequiredDefaultNotes
urlstring (uri)Yes-The URL to scrape
FieldTypeDefaultNotes
formatsarray["markdown"]Output formats (string or object forms). See Output Formats.
onlyMainContentbooleantrueAttempts to return only the main content (remove nav/footer/etc.)
includeTagsstring[]-Include-only filtering (HTML tag / class / id selectors)
excludeTagsstring[]-Exclude filtering (HTML tag / class / id selectors)
removeBase64ImagesbooleantrueRemoves base64 images from Markdown output (keeps alt text)
FieldTypeDefaultNotes
maxAgenumber (ms)172800000Cache freshness window. Improves latency but not credits.
minAgenumber (ms)-Cache-only lookup. If missing, returns 404 with error code SCRAPE_NO_CACHED_DATA.
waitFornumber (ms)0Extra wait time before scraping (on top of smart-wait).
timeoutnumber (ms)60000Range 1000..300000.
FieldTypeDefaultNotes
headersobject-Custom headers (cookies/user-agent/etc.). Some sensitive params may force storeInCache=false.
proxy"basic" | "enhanced" | "auto""auto"Proxy strategy. enhanced is more robust but can cost more.
blockAdsbooleantrueEnables ad-block and cookie popup blocking.
skipTlsVerificationbooleantrueSkips TLS verification.
mobilebooleanfalseEmulates a mobile device.
locationobject-Location + language preferences (country/languages).
FieldTypeDefaultNotes
parsersarray["pdf"]Controls file parsing. PDFs are parsed by default (billed per page). Passing [] skips parsing and returns base64 (flat 1 credit per PDF).

PDF parser object form:

parsers: [{ type: 'pdf', mode: 'auto', maxPages: 20 }]

See: PDF Parser Options

FieldTypeDefaultNotes
actionsarray-Run browser actions before extracting content. See Actions.
profileobject-Enables persistent browser storage across scrape + interact sessions.
FieldTypeDefaultNotes
storeInCachebooleantrueStores results in Firecrawl cache/index. Some sensitive params (e.g. actions/headers) may force false.
zeroDataRetentionbooleanfalseEnables ZDR (requires Firecrawl to enable it for your account).