Agent Bazaarby Saylor Innovations
Menu
ExploreMCPx402InsightsPublishGuidesDocs Connect an Agent GitHub
Beauty & Personal Care · x402 · early usage

Discover a website's URLs in one call: reads robots.txt, its declared sitemap(s) (sitem…

Discover a website's URLs in one call: reads robots.txt, its declared sitemap(s) (sitemap indexes and gzipped sitemaps included, /sitemap.xml as the fallback) and the start page's internal links, then returns a same-host, normalized, deduplicated list (up to…

by agent402.tools · discovered, not yet claimed by its owner · updated 2026-10-08

30d calls4
30d payers4
MethodPOST
Outputjson

Mirrored from Coinbase's public x402 Bazaar. The description is the provider's own text and has not been reviewed here; the payment requirements are copied as published.

What it does

Discover a website's URLs in one call: reads robots.txt, its declared sitemap(s) (sitemap indexes and gzipped sitemaps included, /sitemap.xml as the fallback) and the start page's internal links, then returns a same-host, normalized, deduplicated list (up to 500) with an optional substring filter. Hard budgets: at most 6 fetches, 15 seconds, 5 MB. Use it to pick which pages to crawl or extract next.

Tags: web · sitemap · crawl · urls · discovery · bazaar · builder-code · payment-identifier

Call contract

Method
POST
Input
json
Output
json
Last paid call
2026-10-08
Input example from Bazaar metadata
{
  "limit": 50,
  "url": "https://agent402.tools"
}
Output example
{
  "fetchedAt": "2026-08-22T00:00:00.000Z",
  "fetches": 6,
  "host": "agent402.tools",
  "search": null,
  "sitemapsRead": 4,
  "source": "robots.txt, sitemap(s) and start-page links, fetched live",
  "sources": {
    "links": 78,
    "sitemap": 1028
  },
  "total": 1106,
  "truncated": true,
  "url": "https://agent402.tools/",
  "urls": [
    "https://agent402.tools/",
    "https://agent402.tools/decide",
    "https://agent402.tools/reports",
    "https://agent402.tools/monitors"
  ],
  "warnings": []
}

Use with an agent

  1. Discover. Agents find this listing with GET https://bazaar.saylorinnovations.com/discovery/search?query=…, the MCP tool search_resources, or /discovery/resources.
  2. Inspect. Fetch /resources/27892.json for the price and payment options.
  3. Pay. Call GET https://agent402.tools/api/site-map. The provider answers 402 with its payment requirements. An x402 client signs one of the options below and retries with PAYMENT-SIGNATURE.
  4. Execute. The provider returns 200 with the data. Agent Bazaar is not in the request path and never sees your payment.

For humans

You don't need an account or an API key; you need a wallet holding a small amount of USDC on Base, Polygon, Arbitrum One, eip155:143, Avalanche, eip155:1329, Optimism, eip155:4663, eip155:42220, Solana, stellar:pubnet, algorand:wGHE2Pwdvd7S12BL5FaOP20EGYesN73ktiC1qzkkit8=, and an x402-capable client (see the examples below). Call the endpoint unpaid first to see exactly what it asks for.

Pricing & payment

Price
$0.005 / request
Protocol
x402 v2
Auth
No account or API key. Pay per request.
Networks
Base, Polygon, Arbitrum One, eip155:143, Avalanche, eip155:1329, Optimism, eip155:4663, eip155:42220, Solana, stellar:pubnet, algorand:wGHE2Pwdvd7S12BL5FaOP20EGYesN73ktiC1qzkkit8=
Demand
4 calls · 4 unique payers in 30d (public x402 Bazaar data)

x402 payment requirements

SchemeNetworkAssetAmountPay toTimeout
exactBase
eip155:8453		USDC$0.0050xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0300s
exactPolygon
eip155:137		USDC$0.0050xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0300s
exactArbitrum One
eip155:42161		USDC$0.0050xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0300s
exacteip155:143
eip155:143		0x754704Bc059F8C67012fEd69BC8A327a5aafb60350000xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0300s
exactAvalanche
eip155:43114		0xB97EF9Ef8734C71904D8002F8b6Bc66Dd9c48a6E50000xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0300s
exacteip155:1329
eip155:1329		0xe15fC38F6D8c56aF07bbCBe3BAf5708A2Bf4239250000xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0300s
exactOptimism
eip155:10		0x0b2C639c533813f4Aa9D7837CAf62653d097Ff8560000xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0300s
exacteip155:4663
eip155:4663		0x5fc5360D0400a0Fd4f2af552ADD042D716F1d16850000xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0300s
exacteip155:42220
eip155:42220		0xcebA9300f2b948710d2653dD7B07f33A8B32118C50000xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0300s
uptoBase
eip155:8453		USDC$0.0050xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0300s
exactSolana
solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp		USDC$0.005J7aN3PLJnTCF5qpEnvJHJsnCjcGuqC2rYtEM8Gv3xwg300s
exactstellar:pubnet
stellar:pubnet		CCW67TSZV3SSS2HXMBQ5JFGCKJNXKZM7UQUWUZPUTHXSTZLEO7SJMI7550000GDNJXCKW7ZM7GEEVP674TWPU26YJNBQ2FI4ZIPRKTPTNUEJMDHFJWWRL300s
exactalgorand:wGHE2Pwdvd7S12BL5FaOP20EGYesN73ktiC1qzkkit8=
algorand:wGHE2Pwdvd7S12BL5FaOP20EGYesN73ktiC1qzkkit8=		315667045000C7IIHG7SPLPZ5H7ZT6HW3UV2OQMQQE6Y2HBNGZXSLRJULE42BEE2OY2XIE300s
accepts[] (raw JSON)
[
  {
    "scheme": "exact",
    "network": "eip155:8453",
    "payTo": "0xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0",
    "asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
    "amount": "5000",
    "amountUsd": 0.005,
    "maxTimeoutSeconds": 300
  },
  {
    "scheme": "exact",
    "network": "eip155:137",
    "payTo": "0xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0",
    "asset": "0x3c499c542cEF5E3811e1192ce70d8cC03d5c3359",
    "amount": "5000",
    "amountUsd": 0.005,
    "maxTimeoutSeconds": 300
  },
  {
    "scheme": "exact",
    "network": "eip155:42161",
    "payTo": "0xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0",
    "asset": "0xaf88d065e77c8cC2239327C5EDb3A432268e5831",
    "amount": "5000",
    "amountUsd": 0.005,
    "maxTimeoutSeconds": 300
  },
  {
    "scheme": "exact",
    "network": "eip155:143",
    "payTo": "0xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0",
    "asset": "0x754704Bc059F8C67012fEd69BC8A327a5aafb603",
    "amount": "5000",
    "maxTimeoutSeconds": 300
  },
  {
    "scheme": "exact",
    "network": "eip155:43114",
    "payTo": "0xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0",
    "asset": "0xB97EF9Ef8734C71904D8002F8b6Bc66Dd9c48a6E",
    "amount": "5000",
    "maxTimeoutSeconds": 300
  },
  {
    "scheme": "exact",
    "network": "eip155:1329",
    "payTo": "0xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0",
    "asset": "0xe15fC38F6D8c56aF07bbCBe3BAf5708A2Bf42392",
    "amount": "5000",
    "maxTimeoutSeconds": 300
  },
  {
    "scheme": "exact",
    "network": "eip155:10",
    "payTo": "0xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0",
    "asset": "0x0b2C639c533813f4Aa9D7837CAf62653d097Ff85",
    "amount": "6000",
    "maxTimeoutSeconds": 300
  },
  {
    "scheme": "exact",
    "network": "eip155:4663",
    "payTo": "0xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0",
    "asset": "0x5fc5360D0400a0Fd4f2af552ADD042D716F1d168",
    "amount": "5000",
    "maxTimeoutSeconds": 300
  },
  {
    "scheme": "exact",
    "network": "eip155:42220",
    "payTo": "0xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0",
    "asset": "0xcebA9300f2b948710d2653dD7B07f33A8B32118C",
    "amount": "5000",
    "maxTimeoutSeconds": 300
  },
  {
    "scheme": "upto",
    "network": "eip155:8453",
    "payTo": "0xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0",
    "asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
    "amount": "5000",
    "amountUsd": 0.005,
    "maxTimeoutSeconds": 300
  },
  {
    "scheme": "exact",
    "network": "solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp",
    "payTo": "J7aN3PLJnTCF5qpEnvJHJsnCjcGuqC2rYtEM8Gv3xwg",
    "asset": "EPjFWdd5AufqSSqeM2qN1xzybapC8G4wEGGkZwyTDt1v",
    "amount": "5000",
    "amountUsd": 0.005,
    "maxTimeoutSeconds": 300
  },
  {
    "scheme": "exact",
    "network": "stellar:pubnet",
    "payTo": "GDNJXCKW7ZM7GEEVP674TWPU26YJNBQ2FI4ZIPRKTPTNUEJMDHFJWWRL",
    "asset": "CCW67TSZV3SSS2HXMBQ5JFGCKJNXKZM7UQUWUZPUTHXSTZLEO7SJMI75",
    "amount": "50000",
    "maxTimeoutSeconds": 300
  },
  {
    "scheme": "exact",
    "network": "algorand:wGHE2Pwdvd7S12BL5FaOP20EGYesN73ktiC1qzkkit8=",
    "payTo": "C7IIHG7SPLPZ5H7ZT6HW3UV2OQMQQE6Y2HBNGZXSLRJULE42BEE2OY2XIE",
    "asset": "31566704",
    "amount": "5000",
    "maxTimeoutSeconds": 300
  }
]

Schemas

Output schema (JSON Schema)
{
  "properties": {
    "example": {
      "properties": {
        "fetchedAt": {
          "type": "string"
        },
        "fetches": {
          "type": "integer"
        },
        "host": {
          "type": "string"
        },
        "search": {},
        "sitemapsRead": {
          "type": "integer"
        },
        "source": {
          "type": "string"
        },
        "sources": {
          "type": "object"
        },
        "total": {
          "type": "integer"
        },
        "truncated": {
          "type": "boolean"
        },
        "url": {
          "type": "string"
        },
        "urls": {
          "type": "array"
        },
        "warnings": {
          "type": "array"
        }
      },
      "required": [
        "url",
        "host",
        "total",
        "urls",
        "sources",
        "sitemapsRead",
        "truncated",
        "fetches",
        "warnings",
        "source",
        "fetchedAt"
      ],
      "type": "object"
    },
    "type": {
      "type": "string"
    }
  },
  "required": [
    "type"
  ],
  "type": "object"
}
Example shape — generated from the schema, not a captured live response
{
  "example": {
    "fetchedAt": "string",
    "fetches": 0,
    "host": "string",
    "search": null,
    "sitemapsRead": 0,
    "source": "string",
    "sources": {},
    "total": 0,
    "truncated": true,
    "url": "string",
    "urls": [
      "value"
    ],
    "warnings": [
      "value"
    ]
  },
  "type": "string"
}

Examples

curl
curl -X POST 'https://agent402.tools/api/site-map' -H 'Content-Type: application/json' --data '{"limit":50,"url":"https://agent402.tools"}'
# -> 402 Payment Required; read PAYMENT-REQUIRED
# retry the identical request with PAYMENT-SIGNATURE
JavaScript
const res = await fetch("https://agent402.tools/api/site-map", {
  "method": "POST",
  "headers": {
    "content-type": "application/json"
  },
  "body": "{\"limit\":50,\"url\":\"https://agent402.tools\"}"
});
if (res.status === 402) {
  const { accepts } = await res.json();
  // pay one of accepts[] via an x402 client, then retry with the payment header
}
Python
import httpx
import json
res = httpx.request("POST", "https://agent402.tools/api/site-map", json=json.loads("{\"limit\":50,\"url\":\"https://agent402.tools\"}"))
if res.status_code == 402:
    accepts = res.json()["accepts"]
    # pay one of accepts[] via an x402 client, then retry with the payment header

Details

Provider
agent402.tools
Endpoint
https://agent402.tools/api/site-map
Machine-readable
/resources/27892.json