api.strale.io
https://api.strale.io/x402/robots-txt-parseShares a payout wallet with 268 other endpoints — its adoption is attributed from that shared wallet's traffic, not earned exclusively.
Fetch and parse a website's robots.txt. Returns rules per user-agent, sitemaps, crawl delays, and whether all crawlers are blocked.
Reliability & health
Uptime and response time from our own unpaid probes, plus the reliability score built from them.
Uptime
100.0% avgResponse time
p50 27ms · p95 48msData table
| Bucket | Uptime | Probes | Response time |
|---|---|---|---|
| 8/13/2026, 3:00:00 PM | 100% | 1 | 50ms |
| 8/13/2026, 4:00:00 PM | 100% | 1 | 28ms |
| 8/13/2026, 5:00:00 PM | 100% | 1 | 38ms |
| 8/13/2026, 7:00:00 PM | 100% | 1 | 29ms |
| 8/13/2026, 8:00:00 PM | 100% | 1 | 25ms |
| 8/13/2026, 9:00:00 PM | 100% | 1 | 27ms |
| 8/13/2026, 10:00:00 PM | 100% | 1 | 25ms |
| 8/13/2026, 11:00:00 PM | 100% | 1 | 26ms |
| 8/14/2026, 12:00:00 AM | 100% | 1 | 25ms |
| 8/14/2026, 2:00:00 AM | 100% | 1 | 25ms |
| 8/14/2026, 3:00:00 AM | 100% | 1 | 26ms |
| 8/14/2026, 4:00:00 AM | 100% | 1 | 27ms |
| 8/14/2026, 5:00:00 AM | 100% | 1 | 25ms |
| 8/14/2026, 6:00:00 AM | 100% | 1 | 25ms |
| 8/14/2026, 7:00:00 AM | 100% | 1 | 28ms |
| 8/14/2026, 9:00:00 AM | 100% | 1 | 30ms |
| 8/14/2026, 10:00:00 AM | 100% | 1 | 26ms |
| 8/14/2026, 11:00:00 AM | 100% | 1 | 70ms |
| 8/14/2026, 12:00:00 PM | 100% | 1 | 40ms |
| 8/14/2026, 1:00:00 PM | 100% | 1 | 28ms |
| 8/14/2026, 3:00:00 PM | 100% | 1 | 27ms |
| 8/14/2026, 4:00:00 PM | 100% | 1 | 26ms |
| 8/14/2026, 5:00:00 PM | 100% | 1 | 26ms |
| 8/14/2026, 6:00:00 PM | 100% | 1 | 27ms |
| 8/14/2026, 7:00:00 PM | 100% | 1 | 24ms |
| 8/14/2026, 9:00:00 PM | 100% | 1 | 33ms |
| 8/14/2026, 10:00:00 PM | 100% | 1 | 26ms |
| 8/14/2026, 11:00:00 PM | 100% | 1 | 27ms |
| 8/15/2026, 12:00:00 AM | 100% | 1 | 25ms |
| 8/15/2026, 1:00:00 AM | 100% | 1 | 27ms |
| 8/15/2026, 2:00:00 AM | 100% | 1 | 25ms |
| 8/15/2026, 3:00:00 AM | 100% | 1 | 25ms |
| 8/15/2026, 5:00:00 AM | 100% | 1 | 25ms |
| 8/15/2026, 6:00:00 AM | 100% | 1 | 25ms |
| 8/15/2026, 7:00:00 AM | 100% | 1 | 25ms |
| 8/15/2026, 8:00:00 AM | 100% | 1 | 26ms |
| 8/15/2026, 9:00:00 AM | 100% | 1 | 27ms |
| 8/15/2026, 10:00:00 AM | 100% | 1 | 44ms |
| 8/15/2026, 11:00:00 AM | 100% | 1 | 26ms |
| 8/15/2026, 1:00:00 PM | 100% | 1 | 28ms |
| 8/15/2026, 2:00:00 PM | 100% | 1 | 27ms |
| 8/15/2026, 3:00:00 PM | 100% | 1 | 31ms |
| 8/15/2026, 4:00:00 PM | 100% | 1 | 24ms |
| 8/15/2026, 5:00:00 PM | 100% | 1 | 25ms |
| 8/15/2026, 6:00:00 PM | 100% | 1 | 24ms |
| 8/15/2026, 8:00:00 PM | 100% | 1 | 27ms |
| 8/15/2026, 9:00:00 PM | 100% | 1 | 28ms |
| 8/15/2026, 10:00:00 PM | 100% | 1 | 28ms |
| 8/15/2026, 11:00:00 PM | 100% | 1 | 24ms |
| 8/16/2026, 12:00:00 AM | 100% | 1 | 25ms |
| 8/16/2026, 1:00:00 AM | 100% | 1 | 26ms |
| 8/16/2026, 3:00:00 AM | 100% | 1 | 45ms |
| 8/16/2026, 4:00:00 AM | 100% | 1 | 29ms |
| 8/16/2026, 5:00:00 AM | 100% | 1 | 27ms |
| 8/16/2026, 6:00:00 AM | 100% | 1 | 26ms |
| 8/16/2026, 7:00:00 AM | 100% | 1 | 24ms |
| 8/16/2026, 8:00:00 AM | 100% | 1 | 25ms |
| 8/16/2026, 10:00:00 AM | 100% | 1 | 26ms |
| 8/16/2026, 11:00:00 AM | 100% | 1 | 27ms |
| 8/16/2026, 12:00:00 PM | 100% | 1 | 27ms |
| 8/16/2026, 1:00:00 PM | 100% | 1 | 26ms |
| 8/16/2026, 2:00:00 PM | 100% | 1 | 24ms |
| 8/16/2026, 3:00:00 PM | 100% | 1 | 25ms |
| 8/16/2026, 5:00:00 PM | 100% | 1 | 132ms |
| 8/16/2026, 6:00:00 PM | 100% | 1 | 25ms |
| 8/16/2026, 7:00:00 PM | 100% | 1 | 46ms |
| 8/16/2026, 8:00:00 PM | 100% | 1 | 28ms |
| 8/16/2026, 9:00:00 PM | 100% | 1 | 24ms |
| 8/16/2026, 10:00:00 PM | 100% | 1 | 26ms |
| 8/17/2026, 12:00:00 AM | 100% | 1 | 27ms |
| 8/17/2026, 1:00:00 AM | 100% | 1 | 26ms |
| 8/17/2026, 2:00:00 AM | 100% | 1 | 25ms |
| 8/17/2026, 3:00:00 AM | 100% | 1 | 26ms |
| 8/17/2026, 4:00:00 AM | 100% | 1 | 25ms |
| 8/17/2026, 5:00:00 AM | 100% | 1 | 27ms |
| 8/17/2026, 7:00:00 AM | 100% | 1 | 26ms |
| 8/17/2026, 8:00:00 AM | 100% | 1 | 26ms |
| 8/17/2026, 9:00:00 AM | 100% | 1 | 26ms |
| 8/17/2026, 10:00:00 AM | 100% | 1 | 29ms |
| 8/17/2026, 11:00:00 AM | 100% | 1 | 28ms |
| 8/17/2026, 12:00:00 PM | 100% | 1 | 30ms |
| 8/17/2026, 2:00:00 PM | 100% | 1 | 28ms |
| 8/17/2026, 3:00:00 PM | 100% | 1 | 34ms |
| 8/17/2026, 4:00:00 PM | 100% | 1 | 34ms |
| 8/17/2026, 5:00:00 PM | 100% | 1 | 26ms |
| 8/17/2026, 6:00:00 PM | 100% | 1 | 33ms |
| 8/17/2026, 7:00:00 PM | 100% | 1 | 27ms |
| 8/17/2026, 9:00:00 PM | 100% | 1 | 48ms |
| 8/17/2026, 10:00:00 PM | 100% | 1 | 27ms |
| 8/17/2026, 11:00:00 PM | 100% | 1 | 24ms |
| 8/18/2026, 12:00:00 AM | 100% | 1 | 34ms |
| 8/18/2026, 1:00:00 AM | 100% | 1 | 28ms |
| 8/18/2026, 2:00:00 AM | 100% | 1 | 24ms |
| 8/18/2026, 4:00:00 AM | 100% | 1 | 26ms |
| 8/18/2026, 5:00:00 AM | 100% | 1 | 24ms |
| 8/18/2026, 6:00:00 AM | 100% | 1 | 27ms |
| 8/18/2026, 7:00:00 AM | 100% | 1 | 26ms |
| 8/18/2026, 8:00:00 AM | 100% | 1 | 24ms |
| 8/18/2026, 9:00:00 AM | 100% | 1 | 25ms |
| 8/18/2026, 11:00:00 AM | 100% | 1 | 25ms |
| 8/18/2026, 12:00:00 PM | 100% | 1 | 27ms |
| 8/18/2026, 1:00:00 PM | 100% | 1 | 108ms |
| 8/18/2026, 2:00:00 PM | 100% | 1 | 30ms |
| 8/18/2026, 3:00:00 PM | 100% | 1 | 27ms |
| 8/18/2026, 4:00:00 PM | 100% | 1 | 27ms |
| 8/18/2026, 6:00:00 PM | 100% | 1 | 81ms |
| 8/18/2026, 7:00:00 PM | 100% | 1 | 27ms |
| 8/18/2026, 8:00:00 PM | 100% | 1 | 32ms |
| 8/18/2026, 9:00:00 PM | 100% | 1 | 30ms |
| 8/18/2026, 10:00:00 PM | 100% | 1 | 26ms |
| 8/18/2026, 11:00:00 PM | 100% | 1 | 43ms |
| 8/19/2026, 1:00:00 AM | 100% | 1 | 28ms |
| 8/19/2026, 2:00:00 AM | 100% | 1 | 26ms |
| 8/19/2026, 3:00:00 AM | 100% | 1 | 29ms |
| 8/19/2026, 4:00:00 AM | 100% | 1 | 27ms |
| 8/19/2026, 5:00:00 AM | 100% | 1 | 26ms |
| 8/19/2026, 6:00:00 AM | 100% | 1 | 25ms |
| 8/19/2026, 8:00:00 AM | 100% | 1 | 74ms |
| 8/19/2026, 9:00:00 AM | 100% | 1 | 26ms |
| 8/19/2026, 10:00:00 AM | 100% | 1 | 27ms |
| 8/19/2026, 11:00:00 AM | 100% | 1 | 34ms |
| 8/19/2026, 12:00:00 PM | 100% | 1 | 32ms |
| 8/19/2026, 1:00:00 PM | 100% | 1 | 25ms |
| 8/19/2026, 3:00:00 PM | 100% | 1 | 28ms |
| 8/19/2026, 4:00:00 PM | 100% | 1 | 30ms |
| 8/19/2026, 5:00:00 PM | 100% | 1 | 28ms |
| 8/19/2026, 6:00:00 PM | 100% | 1 | 29ms |
| 8/19/2026, 7:00:00 PM | 100% | 1 | 27ms |
| 8/19/2026, 8:00:00 PM | 100% | 1 | 32ms |
| 8/19/2026, 9:00:00 PM | 100% | 1 | 55ms |
| 8/19/2026, 11:00:00 PM | 100% | 1 | 31ms |
| 8/20/2026, 12:00:00 AM | 100% | 1 | 31ms |
| 8/20/2026, 1:00:00 AM | 100% | 1 | 31ms |
| 8/20/2026, 2:00:00 AM | 100% | 1 | 30ms |
| 8/20/2026, 3:00:00 AM | 100% | 1 | 28ms |
| 8/20/2026, 4:00:00 AM | 100% | 1 | 27ms |
| 8/20/2026, 6:00:00 AM | 100% | 1 | 30ms |
| 8/20/2026, 7:00:00 AM | 100% | 1 | 30ms |
| 8/20/2026, 8:00:00 AM | 100% | 1 | 27ms |
| 8/20/2026, 9:00:00 AM | 100% | 1 | 30ms |
| 8/20/2026, 10:00:00 AM | 100% | 1 | 27ms |
| 8/20/2026, 11:00:00 AM | 100% | 1 | 28ms |
| 8/20/2026, 1:00:00 PM | 100% | 1 | 29ms |
- Availability
- 100
- Latency
- 100
- Security
- 100
- Transparency
- 61
- Activity
- 1
How often it was reachable when we probed it (weight 35%).
How quickly it answers when it is up — fast scores high (weight 20%).
Whether it serves over working TLS / https (weight 15%).
Whether the operator disclosed what it does — description, schema, identity (weight 15%).
Observed on-chain payments to this endpoint's wallet — transactions, volume, and distinct paying wallets over the last month (weight 15%; not yet measured when we have not seen its wallet settle).
Confidence 100% — how much probe evidence backs this score. A thin history is flagged, not hidden.
See the scoring methodology for exactly how each number is computed.
Payment
- Currencies
- USDC
- Networks
- base
- Facilitator
- unknown
- SDK
- unknown
Operator
- Company
- inferred — unknown
- Jurisdiction
- —
- Registrar
- —
- Domain registered
- —
- Hosting network
- RLWY-HIKARI-01
- Hosting country
- —
Operator context is derived from public RDAP/TLS records and unverified. Company and country are only available for endpoints that publish them (an OV/EV TLS certificate or a non-redacted domain record); most endpoints are CDN-fronted and disclose neither.
On-chain activity (base)
Payments per day
last payment 8/20/2026Data table
| Day | Payments | Volume (USD) | Paying wallets |
|---|---|---|---|
| 7/22/2026 | 139 | 11.67 | 5 |
| 7/23/2026 | 76 | 6.23 | 3 |
| 7/24/2026 | 195 | 13.53 | 1 |
| 8/1/2026 | 151 | 9.32 | 3 |
| 8/2/2026 | 35 | 1.91 | 1 |
| 8/4/2026 | 5 | 0.43 | 3 |
| 8/5/2026 | 3 | 0.43 | 3 |
| 8/6/2026 | 73 | 4.3 | 1 |
| 8/7/2026 | 162 | 7.35 | 2 |
| 8/8/2026 | 40 | 3.01 | 1 |
| 8/9/2026 | 146 | 13.32 | 1 |
| 8/10/2026 | 131 | 13.05 | 1 |
| 8/11/2026 | 62 | 5.21 | 1 |
| 8/12/2026 | 106 | 8 | 2 |
| 8/13/2026 | 97 | 4.86 | 2 |
| 8/14/2026 | 40 | 2.14 | 2 |
| 8/15/2026 | 124 | 6 | 1 |
| 8/16/2026 | 56 | 3.12 | 1 |
| 8/17/2026 | 186 | 17.59 | 1 |
| 8/18/2026 | 190 | 11.85 | 2 |
| 8/19/2026 | 195 | 9.42 | 1 |
| 8/20/2026 | 67 | 3.77 | 1 |
This payout wallet is shared: figures cover all 269 endpoints paid at it, since payments cannot be attributed to one of them. Only payments settled on chains and facilitators we index.
Linked by wallet — likely same operator
On-chain agent identity and the x402 endpoint that shares its settlement wallet.
Response schema
{
"example": {
"blocks_all_crawlers": false,
"exists": true,
"raw_length": 505,
"rules": [
{
"allow": [
"/"
],
"disallow": [],
"user_agent": "Googlebot"
},
{
"allow": [
"/"
],
"disallow": [],
"user_agent": "Bingbot"
},
{
"allow": [
"/"
],
"disallow": [],
"user_agent": "Twitterbot"
},
{
"allow": [
"/"
],
"disallow": [],
"user_agent": "facebookexternalhit"
},
{
"allow": [
"/"
],
"disallow": [],
"user_agent": "GPTBot"
},
{
"allow": [
"/"
],
"disallow": [],
"user_agent": "Claude-Web"
},
{
"allow": [
"/"
],
"disallow": [],
"user_agent": "anthropic-ai"
},
{
"allow": [
"/"
],
"disallow": [],
"user_agent": "Google-Extended"
},
{
"allow": [
"/"
],
"disallow": [],
"user_agent": "Amazonbot"
},
{
"allow": [
"/"
],
"disallow": [],
"user_agent": "cohere-ai"
},
{
"allow": [
"/"
],
"disallow": [],
"user_agent": "PerplexityBot"
},
{
"allow": [
"/",
"/.well-known/"
],
"disallow": [],
"user_agent": "*"
}
],
"sitemaps": [
"https://strale.dev/sitemap.xml"
],
"total_allow_rules": 13,
"total_disallow_rules": 0,
"total_rules": 12,
"url": "https://strale.dev/robots.txt",
"user_agents": [
"Googlebot",
"Bingbot",
"Twitterbot",
"facebookexternalhit",
"GPTBot",
"Claude-Web",
"anthropic-ai",
"Google-Extended",
"Amazonbot",
"cohere-ai",
"PerplexityBot",
"*"
]
},
"properties": {
"blocks_all_crawlers": {
"type": "boolean"
},
"exists": {
"type": "boolean"
},
"rules": {
"type": "array"
},
"sitemaps": {
"type": "array"
},
"user_agents": {
"type": "array"
}
},
"type": "object"
}