Skip to main content
POST /v1/data/web/scrape/run Pricing: $0.0025 per page ($2.50 per 1,000).

Ways to call it

  • By URL: set urls
  • Search: set query (optional: maxResults)

Request

Send the inputs under params. Only the keys below are accepted; any other key returns 422 invalid_params.
string[]
Web pages or PDF links to scrape, up to 1,000 per request. Failed pages are returned with an error and not charged.
string
Keyword to search the web for. The top results are fetched and converted to Markdown.
integer
default:"10"
How many search results to scrape. Defaults to 10; at most 20.Max 20.

Example

Response fields

Each row in data is one page, keyed by these fields.

Example response

Abridged: long text and lists are shortened.
For a whole site rather than one page use web/crawl; for a site’s URL list without page content use web/map; for named fields as JSON use web/extract.