web · web · audit · robots · sitemap · crawler · seo · website

Robots and sitemap audit

Inspect a domain's robots.txt crawl rules and XML sitemap health, availability, and URL count.

$0.025 USDCBase + Solanax402 v2POST

Pay $0.025 USDC and run in your browser View free result sample

Endpoint

https://apiacre.com/v1/web/robots-sitemap

Send the JSON body below. An unpaid request returns HTTP 402 with a PAYMENT-REQUIRED header; an x402-compatible buyer signs the requirement and retries with PAYMENT-SIGNATURE.

Pay $0.025 USDC and run in your browser

Official Coinbase agent path

Coinbase Agentic Wallet can satisfy this x402 request in one command. Running it may pay automatically, so --max-amount is fixed to $0.025 USDC in atomic units. Copying the command does not install, authenticate, sign, or pay; review the request and use a separate low-value wallet before running it.

npx --yes awal@latest x402 pay https://apiacre.com/v1/web/robots-sitemap \
  -X POST \
  -d '{"url":"https://example.com"}' \
  --max-amount 25000 \
  --json

Coinbase pay-for-service documentation · Buyer setup and wallet safety

Alternative third-party AgentCash commands

Run check first without payment. Its fetch command may automatically pay up to the exact listed price.

npx --yes agentcash@latest check https://apiacre.com/v1/web/robots-sitemap
npx --yes agentcash@latest fetch https://apiacre.com/v1/web/robots-sitemap \
  --method POST \
  --header 'content-type: application/json' \
  --body '{"url":"https://example.com"}' \
  --payment-protocol x402 \
  --payment-network base \
  --max-amount 0.025

AgentCash CLI documentation

Input example

{
  "url": "https://example.com"
}

Response shape

View free static sample JSON

{
  "request_id": "018f1f54-7f38-7ba2-8dc3-5f90272d9f1a",
  "service": "web.robots-sitemap",
  "version": "1",
  "data": {
    "origin": "https://example.com",
    "robots": {
      "available": false,
      "statusCode": 404,
      "contentType": "text/html",
      "sitemaps": [],
      "rules": 0
    },
    "sitemap": {
      "available": false,
      "statusCode": 404,
      "contentType": "text/html",
      "urlCount": 0,
      "bytes": 0
    }
  },
  "meta": {
    "duration_ms": 42,
    "cached": false,
    "sources": [],
    "warnings": [],
    "next_actions": []
  }
}

Try the payment challenge

curl -i -X POST 'https://apiacre.com/v1/web/robots-sitemap' \
  -H 'content-type: application/json' \
  --data '{"url":"https://example.com"}'