POST /v1/data/web/scrape/run
Pricing: $0.0025 per page ($2.50 per 1,000).
Ways to call it
- By URL: set
urls - Search: set
query(optional:maxResults)
Request
Send the inputs underparams. Only the keys below are accepted; any other key returns 422 invalid_params.
Web pages or PDF links to scrape, up to 1,000 per request. Failed pages are returned with an error and not charged.
Example
Response fields
Each row indata is one page, keyed by these fields.
Example response
Abridged: long text and lists are shortened.Related APIs
For a whole site rather than one page useweb/crawl; for a site’s URL list without page content use web/map; for named fields as JSON use web/extract.