▣ DATA EXTRACTION · SEO

AI-ready Clean Data Extractor API

Hosted on ApyHub

What it does

Webpage Extractor turns a webpage URL into structured page data. Send an HTTP or HTTPS URL, and get back the page title plus extracted links, images, tables, headings, sections, summary text, and page metadata.

Use it when you need to pull content from articles, documentation pages, or product pages without hand-parsing HTML. The response also includes link classification, so you can separate internal and external URLs, and a quality object with a score and warnings to help you spot pages that were only partially extracted.

The output is built for downstream automation: page_type helps you route the result, published_date can support freshness checks, and content_markdown, clean_markdown, or raw_markdown give you different levels of normalized page text depending on your workflow. author and category are included when they can be identified.

If you are building a content pipeline, a crawler, a search indexer, or a knowledge base importer, Webpage Extractor gives you a single structured response from a page URL.

POST

Extract structured content from a webpage

http://localhost:8080/apyhub/webpage-extractor-api

QUICKSTARTGUIDE

Quickstart

Fetch structured content from a webpage by sending its URL.

curl -X POST "http://localhost:8080/apyhub/webpage-extractor-api" \
  -H "apy-token: $APY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://apyhub.com"}'

What you'll get back

Returns a JSON object with a data object containing the extracted page content. The data object can include fields like title, summary, links, images, tables, headings, sections, metadata, and page_type, along with other structured content from the page.

{
  "data": {
    "title": "Example page title",
    "summary": "Short page summary",
    "page_type": "article"
  }
}

TRY ITLIVE · 50 ATOMS

API key

Loading your default key…

The full key is used to call the gateway and stays in this tab — never sent to orbit or saved.

About this endpoint

What it does

Extracts structured content from a webpage given its URL and returns a JSON object containing the scraped page data under data.

Request Body

Parameter	Type	Mandatory	Description
url	String	Yes	HTTP/HTTPS URL of the page to scrape. Format: URI.

Response

Returns a JSON object with a required data object field containing structured page content. The data object may include page-level fields such as links, title, author, images, tables, quality, summary, category, headings, metadata, sections, page_type, code_blocks, story_cards, raw_markdown, clean_markdown, published_date, and content_markdown.

Parameter	Type	Mandatory	Description
data	Object	Yes	Structured page content extracted from the webpage.

Body

Name

Type

Description

bodyREQUIRED

object

—

▣ COMMON ERRORS

Errors any endpoint can return

400bad_request

Required parameter missing or malformed body.

401unauthorized

API key missing, revoked, or not authorized for this service.

429rate_limited

Your plan's per-second rate exceeded. Retry with exponential backoff.

503upstream_busy

Backend temporarily unavailable. Try again in a few seconds.