api.strale.io

https://api.strale.io/x402/robots-txt-parse

Shares a payout wallet with 268 other endpoints — its adoption is attributed from that shared wallet's traffic, not earned exclusively.

Fetch and parse a website's robots.txt. Returns rules per user-agent, sitemaps, crawl delays, and whether all crawlers are blocked.

62
reliability

Reliability & health

Uptime and response time from our own unpaid probes, plus the reliability score built from them.

Uptime

100.0% avg
0% 50% 100% Thu 3 PMSat 10 PMTue 6 AMThu 1 PM

Response time

p50 27ms · p95 48ms
0ms 100ms 200ms Thu 3 PMSat 10 PMTue 6 AMThu 1 PM
Data table
Reliability history per time bucket over the last 7 days (hourly).
Bucket Uptime Probes Response time
8/13/2026, 3:00:00 PM 100% 1 50ms
8/13/2026, 4:00:00 PM 100% 1 28ms
8/13/2026, 5:00:00 PM 100% 1 38ms
8/13/2026, 7:00:00 PM 100% 1 29ms
8/13/2026, 8:00:00 PM 100% 1 25ms
8/13/2026, 9:00:00 PM 100% 1 27ms
8/13/2026, 10:00:00 PM 100% 1 25ms
8/13/2026, 11:00:00 PM 100% 1 26ms
8/14/2026, 12:00:00 AM 100% 1 25ms
8/14/2026, 2:00:00 AM 100% 1 25ms
8/14/2026, 3:00:00 AM 100% 1 26ms
8/14/2026, 4:00:00 AM 100% 1 27ms
8/14/2026, 5:00:00 AM 100% 1 25ms
8/14/2026, 6:00:00 AM 100% 1 25ms
8/14/2026, 7:00:00 AM 100% 1 28ms
8/14/2026, 9:00:00 AM 100% 1 30ms
8/14/2026, 10:00:00 AM 100% 1 26ms
8/14/2026, 11:00:00 AM 100% 1 70ms
8/14/2026, 12:00:00 PM 100% 1 40ms
8/14/2026, 1:00:00 PM 100% 1 28ms
8/14/2026, 3:00:00 PM 100% 1 27ms
8/14/2026, 4:00:00 PM 100% 1 26ms
8/14/2026, 5:00:00 PM 100% 1 26ms
8/14/2026, 6:00:00 PM 100% 1 27ms
8/14/2026, 7:00:00 PM 100% 1 24ms
8/14/2026, 9:00:00 PM 100% 1 33ms
8/14/2026, 10:00:00 PM 100% 1 26ms
8/14/2026, 11:00:00 PM 100% 1 27ms
8/15/2026, 12:00:00 AM 100% 1 25ms
8/15/2026, 1:00:00 AM 100% 1 27ms
8/15/2026, 2:00:00 AM 100% 1 25ms
8/15/2026, 3:00:00 AM 100% 1 25ms
8/15/2026, 5:00:00 AM 100% 1 25ms
8/15/2026, 6:00:00 AM 100% 1 25ms
8/15/2026, 7:00:00 AM 100% 1 25ms
8/15/2026, 8:00:00 AM 100% 1 26ms
8/15/2026, 9:00:00 AM 100% 1 27ms
8/15/2026, 10:00:00 AM 100% 1 44ms
8/15/2026, 11:00:00 AM 100% 1 26ms
8/15/2026, 1:00:00 PM 100% 1 28ms
8/15/2026, 2:00:00 PM 100% 1 27ms
8/15/2026, 3:00:00 PM 100% 1 31ms
8/15/2026, 4:00:00 PM 100% 1 24ms
8/15/2026, 5:00:00 PM 100% 1 25ms
8/15/2026, 6:00:00 PM 100% 1 24ms
8/15/2026, 8:00:00 PM 100% 1 27ms
8/15/2026, 9:00:00 PM 100% 1 28ms
8/15/2026, 10:00:00 PM 100% 1 28ms
8/15/2026, 11:00:00 PM 100% 1 24ms
8/16/2026, 12:00:00 AM 100% 1 25ms
8/16/2026, 1:00:00 AM 100% 1 26ms
8/16/2026, 3:00:00 AM 100% 1 45ms
8/16/2026, 4:00:00 AM 100% 1 29ms
8/16/2026, 5:00:00 AM 100% 1 27ms
8/16/2026, 6:00:00 AM 100% 1 26ms
8/16/2026, 7:00:00 AM 100% 1 24ms
8/16/2026, 8:00:00 AM 100% 1 25ms
8/16/2026, 10:00:00 AM 100% 1 26ms
8/16/2026, 11:00:00 AM 100% 1 27ms
8/16/2026, 12:00:00 PM 100% 1 27ms
8/16/2026, 1:00:00 PM 100% 1 26ms
8/16/2026, 2:00:00 PM 100% 1 24ms
8/16/2026, 3:00:00 PM 100% 1 25ms
8/16/2026, 5:00:00 PM 100% 1 132ms
8/16/2026, 6:00:00 PM 100% 1 25ms
8/16/2026, 7:00:00 PM 100% 1 46ms
8/16/2026, 8:00:00 PM 100% 1 28ms
8/16/2026, 9:00:00 PM 100% 1 24ms
8/16/2026, 10:00:00 PM 100% 1 26ms
8/17/2026, 12:00:00 AM 100% 1 27ms
8/17/2026, 1:00:00 AM 100% 1 26ms
8/17/2026, 2:00:00 AM 100% 1 25ms
8/17/2026, 3:00:00 AM 100% 1 26ms
8/17/2026, 4:00:00 AM 100% 1 25ms
8/17/2026, 5:00:00 AM 100% 1 27ms
8/17/2026, 7:00:00 AM 100% 1 26ms
8/17/2026, 8:00:00 AM 100% 1 26ms
8/17/2026, 9:00:00 AM 100% 1 26ms
8/17/2026, 10:00:00 AM 100% 1 29ms
8/17/2026, 11:00:00 AM 100% 1 28ms
8/17/2026, 12:00:00 PM 100% 1 30ms
8/17/2026, 2:00:00 PM 100% 1 28ms
8/17/2026, 3:00:00 PM 100% 1 34ms
8/17/2026, 4:00:00 PM 100% 1 34ms
8/17/2026, 5:00:00 PM 100% 1 26ms
8/17/2026, 6:00:00 PM 100% 1 33ms
8/17/2026, 7:00:00 PM 100% 1 27ms
8/17/2026, 9:00:00 PM 100% 1 48ms
8/17/2026, 10:00:00 PM 100% 1 27ms
8/17/2026, 11:00:00 PM 100% 1 24ms
8/18/2026, 12:00:00 AM 100% 1 34ms
8/18/2026, 1:00:00 AM 100% 1 28ms
8/18/2026, 2:00:00 AM 100% 1 24ms
8/18/2026, 4:00:00 AM 100% 1 26ms
8/18/2026, 5:00:00 AM 100% 1 24ms
8/18/2026, 6:00:00 AM 100% 1 27ms
8/18/2026, 7:00:00 AM 100% 1 26ms
8/18/2026, 8:00:00 AM 100% 1 24ms
8/18/2026, 9:00:00 AM 100% 1 25ms
8/18/2026, 11:00:00 AM 100% 1 25ms
8/18/2026, 12:00:00 PM 100% 1 27ms
8/18/2026, 1:00:00 PM 100% 1 108ms
8/18/2026, 2:00:00 PM 100% 1 30ms
8/18/2026, 3:00:00 PM 100% 1 27ms
8/18/2026, 4:00:00 PM 100% 1 27ms
8/18/2026, 6:00:00 PM 100% 1 81ms
8/18/2026, 7:00:00 PM 100% 1 27ms
8/18/2026, 8:00:00 PM 100% 1 32ms
8/18/2026, 9:00:00 PM 100% 1 30ms
8/18/2026, 10:00:00 PM 100% 1 26ms
8/18/2026, 11:00:00 PM 100% 1 43ms
8/19/2026, 1:00:00 AM 100% 1 28ms
8/19/2026, 2:00:00 AM 100% 1 26ms
8/19/2026, 3:00:00 AM 100% 1 29ms
8/19/2026, 4:00:00 AM 100% 1 27ms
8/19/2026, 5:00:00 AM 100% 1 26ms
8/19/2026, 6:00:00 AM 100% 1 25ms
8/19/2026, 8:00:00 AM 100% 1 74ms
8/19/2026, 9:00:00 AM 100% 1 26ms
8/19/2026, 10:00:00 AM 100% 1 27ms
8/19/2026, 11:00:00 AM 100% 1 34ms
8/19/2026, 12:00:00 PM 100% 1 32ms
8/19/2026, 1:00:00 PM 100% 1 25ms
8/19/2026, 3:00:00 PM 100% 1 28ms
8/19/2026, 4:00:00 PM 100% 1 30ms
8/19/2026, 5:00:00 PM 100% 1 28ms
8/19/2026, 6:00:00 PM 100% 1 29ms
8/19/2026, 7:00:00 PM 100% 1 27ms
8/19/2026, 8:00:00 PM 100% 1 32ms
8/19/2026, 9:00:00 PM 100% 1 55ms
8/19/2026, 11:00:00 PM 100% 1 31ms
8/20/2026, 12:00:00 AM 100% 1 31ms
8/20/2026, 1:00:00 AM 100% 1 31ms
8/20/2026, 2:00:00 AM 100% 1 30ms
8/20/2026, 3:00:00 AM 100% 1 28ms
8/20/2026, 4:00:00 AM 100% 1 27ms
8/20/2026, 6:00:00 AM 100% 1 30ms
8/20/2026, 7:00:00 AM 100% 1 30ms
8/20/2026, 8:00:00 AM 100% 1 27ms
8/20/2026, 9:00:00 AM 100% 1 30ms
8/20/2026, 10:00:00 AM 100% 1 27ms
8/20/2026, 11:00:00 AM 100% 1 28ms
8/20/2026, 1:00:00 PM 100% 1 29ms
62
Composite reliability — the weighted average of the dimensions below, on a 0–100 scale.
Availability
100

How often it was reachable when we probed it (weight 35%).

Latency
100

How quickly it answers when it is up — fast scores high (weight 20%).

Security
100

Whether it serves over working TLS / https (weight 15%).

Transparency
61

Whether the operator disclosed what it does — description, schema, identity (weight 15%).

Activity
1

Observed on-chain payments to this endpoint's wallet — transactions, volume, and distinct paying wallets over the last month (weight 15%; not yet measured when we have not seen its wallet settle).

Confidence 100% — how much probe evidence backs this score. A thin history is flagged, not hidden.

See the scoring methodology for exactly how each number is computed.

Payment

Currencies
USDC
Networks
base
Facilitator
unknown
SDK
unknown

Operator

Company
inferred — unknown
Jurisdiction
Registrar
Domain registered
Hosting network
RLWY-HIKARI-01
Hosting country

Operator context is derived from public RDAP/TLS records and unverified. Company and country are only available for endpoints that publish them (an OV/EV TLS certificate or a non-redacted domain record); most endpoints are CDN-fronted and disclose neither.

On-chain activity (base)

2,279
payments (30d)
156.52
USD volume (30d)
15
paying wallets (30d)

Payments per day

last payment 8/20/2026
0 100 200 Jul 22Aug 6Aug 13Aug 20
Data table
Settled payments per day.
Day Payments Volume (USD) Paying wallets
7/22/2026 139 11.67 5
7/23/2026 76 6.23 3
7/24/2026 195 13.53 1
8/1/2026 151 9.32 3
8/2/2026 35 1.91 1
8/4/2026 5 0.43 3
8/5/2026 3 0.43 3
8/6/2026 73 4.3 1
8/7/2026 162 7.35 2
8/8/2026 40 3.01 1
8/9/2026 146 13.32 1
8/10/2026 131 13.05 1
8/11/2026 62 5.21 1
8/12/2026 106 8 2
8/13/2026 97 4.86 2
8/14/2026 40 2.14 2
8/15/2026 124 6 1
8/16/2026 56 3.12 1
8/17/2026 186 17.59 1
8/18/2026 190 11.85 2
8/19/2026 195 9.42 1
8/20/2026 67 3.77 1

This payout wallet is shared: figures cover all 269 endpoints paid at it, since payments cannot be attributed to one of them. Only payments settled on chains and facilitators we index.

Linked by wallet — likely same operator

On-chain agent identity and the x402 endpoint that shares its settlement wallet.

Response schema
{
  "example": {
    "blocks_all_crawlers": false,
    "exists": true,
    "raw_length": 505,
    "rules": [
      {
        "allow": [
          "/"
        ],
        "disallow": [],
        "user_agent": "Googlebot"
      },
      {
        "allow": [
          "/"
        ],
        "disallow": [],
        "user_agent": "Bingbot"
      },
      {
        "allow": [
          "/"
        ],
        "disallow": [],
        "user_agent": "Twitterbot"
      },
      {
        "allow": [
          "/"
        ],
        "disallow": [],
        "user_agent": "facebookexternalhit"
      },
      {
        "allow": [
          "/"
        ],
        "disallow": [],
        "user_agent": "GPTBot"
      },
      {
        "allow": [
          "/"
        ],
        "disallow": [],
        "user_agent": "Claude-Web"
      },
      {
        "allow": [
          "/"
        ],
        "disallow": [],
        "user_agent": "anthropic-ai"
      },
      {
        "allow": [
          "/"
        ],
        "disallow": [],
        "user_agent": "Google-Extended"
      },
      {
        "allow": [
          "/"
        ],
        "disallow": [],
        "user_agent": "Amazonbot"
      },
      {
        "allow": [
          "/"
        ],
        "disallow": [],
        "user_agent": "cohere-ai"
      },
      {
        "allow": [
          "/"
        ],
        "disallow": [],
        "user_agent": "PerplexityBot"
      },
      {
        "allow": [
          "/",
          "/.well-known/"
        ],
        "disallow": [],
        "user_agent": "*"
      }
    ],
    "sitemaps": [
      "https://strale.dev/sitemap.xml"
    ],
    "total_allow_rules": 13,
    "total_disallow_rules": 0,
    "total_rules": 12,
    "url": "https://strale.dev/robots.txt",
    "user_agents": [
      "Googlebot",
      "Bingbot",
      "Twitterbot",
      "facebookexternalhit",
      "GPTBot",
      "Claude-Web",
      "anthropic-ai",
      "Google-Extended",
      "Amazonbot",
      "cohere-ai",
      "PerplexityBot",
      "*"
    ]
  },
  "properties": {
    "blocks_all_crawlers": {
      "type": "boolean"
    },
    "exists": {
      "type": "boolean"
    },
    "rules": {
      "type": "array"
    },
    "sitemaps": {
      "type": "array"
    },
    "user_agents": {
      "type": "array"
    }
  },
  "type": "object"
}