# Universal Web API

Capture, extract, map, crawl, and screenshot public web content.

- Platform ID: `web`
- Capabilities: 5
- Execute endpoint: `POST https://data.upscrape.com/execute`



## Capabilities

### [Archive page (compatibility)](https://docs.upscrape.com/docs/platforms/web/web.page.archive)

- Capability ID: `web.page.archive`
- Cost: 1 credit per request

Compatibility alias for saved-page capture with automatic inline or hosted delivery up to 50 MB per asset and 500 MB total. Returns explicit outcome and fidelity, requested versus effective asset budgets, per-asset failures, and an embedded upscrape-manifest.json in ZIP artifacts. New integrations should use web.page.capture.
### [Capture page](https://docs.upscrape.com/docs/platforms/web/web.page.capture)

- Capability ID: `web.page.capture`
- Cost: 1 credit per request

Capture one public webpage or content URL with fail-closed HTTP, truncation and OCR semantics, physical-attempt evidence, and optional exact-source, single-HTML or ZIP artifacts.
### [Extract page](https://docs.upscrape.com/docs/platforms/web/web.page.extract)

- Capability ID: `web.page.extract`
- Cost: 1 credit per request

Capture one public webpage or supported content URL and return data shaped by a caller-provided JSON Schema or fields shorthand. Deterministic extraction uses page metadata, the evidence graph, parsed files, and filtered URL enumeration first; internal AI resolves remaining fields per the ai mode.
### [Crawl site](https://docs.upscrape.com/docs/platforms/web/web.site.crawl)

- Capability ID: `web.site.crawl`
- Cost: 1 credit per request

Run a bounded breadth-first crawl across same-site pages and public files with robots rules, explicit scope patterns, controlled concurrency, stateless continuation, source-completeness reconciliation, and optional non-destructive AI relevance ranking.
### [Map site](https://docs.upscrape.com/docs/platforms/web/web.site.map)

- Capability ID: `web.site.map`
- Cost: 1 credit per request

Build a deterministic, robots-aware public URL inventory from the starting page, robots.txt, and bounded recursive sitemap indexes. Classifies pages and files without deeply fetching every discovered URL and supports opaque pagination cursors.

## Common uses

- Turn webpages and public files into traceable structured content, Markdown, and searchable chunks
- Discover downloadable documents, datasets, media, and resources
- Map sitemaps and robots-aware site inventories
- Run bounded, resumable crawls across pages and public files
- Create JPEG screenshots and durable HTML or ZIP snapshots
- Extract caller-defined fields with deterministic and optional AI assistance

## Integration contract

All capabilities use the shared `POST /execute` envelope. A `200` response completed inline; a `202` response must be polled through `GET /jobs/{id}`.

See [authentication](https://docs.upscrape.com/docs/api/authentication), [jobs and results](https://docs.upscrape.com/docs/api/jobs), and [errors and retries](https://docs.upscrape.com/docs/api/errors).
