Minifetch Technical SEO API · Preflight URL Check

by Minifetch Technical SEO API

GETBaseSolana

$0.001

per call · USD Coin on Base

Cheap robots.txt preflight before you pay for other Minifetch endpoints: returns whether the Minifetch user agent may fetch a target URL (allow/deny) plus its crawl-delay. Blocked or setting a crawl delay? https://minifetch.com/tutorials/unblock-minifetch . Checks the URL as given — does not follow redirects. Supports GET & POST

Endpoint

GET https://minifetch.com/api/v1/x402/preflight/url-check

20

Calls / 30d

8

Unique payers / 30d

Sep 10

Last called

exact

Payment scheme

Call this service

TypeScript · @x402/fetch
import { wrapFetchWithPayment } from "@x402/fetch";
import { privateKeyToAccount } from "viem/accounts";

const account = privateKeyToAccount(process.env.PRIVATE_KEY);
const fetchWithPay = wrapFetchWithPayment(fetch, account);

const res = await fetchWithPay("https://minifetch.com/api/v1/x402/preflight/url-check", {
  method: "GET",
});
const data = await res.json();
cURL
curl -X GET \
  "https://minifetch.com/api/v1/x402/preflight/url-check?url=https%3A%2F%2Fgithub.com" \
  -H "X-PAYMENT: <signed x402 payment>"

Example response

{
  "results": [
    {
      "data": {
        "allowed": true,
        "crawlDelay": 1,
        "message": "Access allowed by robots.txt",
        "minifetchCache": {
          "cachedAt": "2026-08-16T18:22:10.000Z",
          "expiresAt": "2026-08-17T18:22:10.000Z",
          "hit": false
        },
        "proxy": {
          "proxyType": "minifetch",
          "userAgent": "minifetch/1.0 (+https://minifetch.com/site-owner-faq)"
        },
        "url": "https://github.com"
      }
    }
  ],
  "success": true
}

Payment details

Pay to0xffa9155a0e4b3d8d42351da226cc1feee449686f
AssetUSD Coin · 0x833589fcd6edb6e08f4c7c32d4f71b54bda02913
NetworksBase, Solana
Schemesexact

Is this your API?

Pin it to the top of Search & Web and the homepage with a featured placement.

Get featured →

More from Minifetch Technical SEO API & similar services