AgentUtility.ai · Scrape Website

by AgentUtility.ai

POSTBaseSolana

$0.04

per call · USD Coin on Base

Scrapes any webpage and pulls title, description, canonical URL, OpenGraph + Twitter card metadata, headings, and outbound links from a single URL. Server-side rendering; body content rendered as text, raw HTML, or clean markdown, with optional link extraction. Cheerio-based with no headless browser, so it is fast and cheap, ideal for static pages and SSR sites. For JS-heavy SPAs that need a real browser, see website-screenshot. Use it as a web scraping API or webpage metadata extractor.

Endpoint

POST https://x402.agentutility.ai/scrape-website

4

Calls / 30d

1

Unique payers / 30d

Sep 6

Last called

exact

Payment scheme

Call this service

TypeScript · @x402/fetch
import { wrapFetchWithPayment } from "@x402/fetch";
import { privateKeyToAccount } from "viem/accounts";

const account = privateKeyToAccount(process.env.PRIVATE_KEY);
const fetchWithPay = wrapFetchWithPayment(fetch, account);

const res = await fetchWithPay("https://x402.agentutility.ai/scrape-website", {
  method: "POST",
  headers: { "Content-Type": "application/json" },
  body: JSON.stringify({
    "format": "text",
    "url": "https://example.com"
  }),
});
const data = await res.json();
cURL
curl -X POST \
  "https://x402.agentutility.ai/scrape-website" \
  -H "Content-Type: application/json" \
  -d '{"format":"text","url":"https://example.com"}' \
  -H "X-PAYMENT: <signed x402 payment>"

Example response

{
  "body_chars": 128,
  "canonical": null,
  "description": "",
  "final_url": "https://example.com/",
  "format": "text",
  "h1": "Example Domain",
  "lang": "en",
  "og": {},
  "status_code": 200,
  "text": "Example Domain\n\nThis domain is for use in documentation examples without needing permission. Avoid use in operations.\n\nLearn more",
  "title": "Example Domain",
  "twitter": {},
  "url": "https://example.com"
}

Payment details

Pay to0x6c0752c09e7f6fa6526fcdf40e456a159ebb5621
AssetUSD Coin · 0x833589fcd6edb6e08f4c7c32d4f71b54bda02913
NetworksBase, Solana
Schemesexact

Is this your API?

Pin it to the top of Search & Web and the homepage with a featured placement.

Get featured →

More from AgentUtility.ai & similar services

AgentUtility.ai · Stocks News

x402.agentutility.ai

Fetches recent stock market news on equities, earnings, IPOs, the Fed, and macro from GDELT with a GNews fallback when configured, returning headline metadata with sentiment and source domains. The equities companion to crypto-news. Data-only news digests; no price prediction, trading advice, or order routing. Use it as a stocks news API, equities news feed, earnings news source, or Wall Street headlines for agents.

POSTBaseMarket Data
$0.005 / call280 calls / 30d

AgentUtility.ai · Search Site

x402.agentutility.ai

Site/domain-scoped search via Decodo Google results. If primary search is quota-limited, a best-effort fallback maps site: to GDELT domain: and returns marked degraded recent public-news results (https://www.gdeltproject.org/); fallback recency is capped at 168 hours and only news-indexed pages can appear. Use it as a domain-search API for agents.

POSTBaseSearch & Web
$0.006 / call83 calls / 30d

AgentUtility.ai · Recent Tweet Search

x402.agentutility.ai

Repeat a saved recent-tweet search to monitor a brand, topic, or phrase over time. Send the same query, language, and max_results on each check; it returns recent public post text, timestamps, metrics, and expanded author profiles. If native X search cannot answer, the tweets array contains clearly labeled public-index results with degraded: true instead of an empty paid response. Read-only: no posting, replying, liking, following, or direct-message access. Use it as a recent tweet search API, Twitter monitoring API, saved-query watchlist, or X public-post search.

POSTBaseSocial & Community
$0.006 / call75 calls / 30d