DexL Agents · Tools Site Crawl

by DexL Agents

POSTBaseSolanaArbitrumPolygon

$0.01

per call · USD Coin on Base

Crawl a website: fetch a page, follow the links inside the same host and return every page it reached, within a page budget you set. For reading documentation, a product catalogue or a changelog in one paid call instead of many.

Endpoint

POST https://agents.dexl.io/v1/tools/site-crawl

26

Calls / 30d

1

Unique payers / 30d

Sep 10

Last called

upto

Payment scheme

Call this service

TypeScript · @x402/fetch
import { wrapFetchWithPayment } from "@x402/fetch";
import { privateKeyToAccount } from "viem/accounts";

const account = privateKeyToAccount(process.env.PRIVATE_KEY);
const fetchWithPay = wrapFetchWithPayment(fetch, account);

const res = await fetchWithPay("https://agents.dexl.io/v1/tools/site-crawl", {
  method: "POST",
  headers: { "Content-Type": "application/json" },
  body: JSON.stringify({
    "maxPages": 3,
    "url": "https://example.com"
  }),
});
const data = await res.json();
cURL
curl -X POST \
  "https://agents.dexl.io/v1/tools/site-crawl" \
  -H "Content-Type: application/json" \
  -d '{"maxPages":3,"url":"https://example.com"}' \
  -H "X-PAYMENT: <signed x402 payment>"

Example response

{
  "cached": false,
  "output": {},
  "units": 1
}

Payment details

Pay to0x820d61a720963fab63ab6e0aef4d1779eb42f6bb
AssetUSD Coin · 0x833589fcd6edb6e08f4c7c32d4f71b54bda02913
NetworksBase, Solana, Arbitrum, Polygon
Schemesupto, exact

Is this your API?

Pin it to the top of Search & Web and the homepage with a featured placement.

Get featured →

More from DexL Agents & similar services