web · web · audit · robots · sitemap · crawler · seo · website

Robots and sitemap audit

Inspect a domain's robots.txt crawl rules and XML sitemap health, availability, and URL count.

$0.025 USDCBasex402 v2POST

Endpoint

https://apiacre.com/v1/web/robots-sitemap

Send the JSON body below. An unpaid request returns HTTP 402 with a PAYMENT-REQUIRED header; an x402-compatible buyer signs the requirement and retries with PAYMENT-SIGNATURE.

Input example

{
  "url": "https://example.com"
}

Response shape

{
  "request_id": "018f1f54-7f38-7ba2-8dc3-5f90272d9f1a",
  "service": "web.robots-sitemap",
  "version": "1",
  "data": {
    "origin": "example",
    "robots": {},
    "sitemap": {}
  },
  "meta": {
    "duration_ms": 42,
    "cached": false,
    "sources": [],
    "warnings": []
  }
}

Try the payment challenge

curl -i -X POST 'https://apiacre.com/v1/web/robots-sitemap' \
  -H 'content-type: application/json' \
  --data '{"url":"https://example.com"}'