web-search-and-content

Crawls the sitemap of the given domain and returns all discovered page URLs. Supports sitemap index files (recursive), parallel fetching with concurrency control, deduplication, and filters out non-page resources (images, PDFs, etc.).

Crawls the sitemap of the given domain and returns all discovered page URLs. Supports sitemap index files (recursive), parallel fetching with concurrency control, deduplication, and filters out non-page resources (images, PDFs, etc.).

Live Web Search: live web search with titles, URLs and snippets Executed deterministically by the AmanChain node against live consensus state (real blocks, pools, balances) — paid per call via x402, settled in USDC on Base. Input: JSON body {"serviceId":"aman-web-search","request":" "}. No account, no API key.

Keyword & Entity Extraction: extract keywords, entities and topics from text Executed deterministically by the AmanChain node against live consensus state (real blocks, pools, balances) — paid per call via x402, settled in USDC on Base. Input: JSON body {"serviceId":"aman-keywords","request":" "}. No account, no API key.

query -> structured search results (title, url, snippet), up to 10 per call. Backed by three providers with automatic failover (DataForSEO primary, Tavily and Serper as fallback) so a single provider outage doesn't take the endpoint down. Pass region=tw for a Traditional Chinese / Taiwan-region search lane. Results are cached for 24 hours per query+region.

Load a URL in headless Chromium with JavaScript executed and get the rendered page back for an LLM or RAG pipeline: markdown, text, HTML, title, links and an optional screenshot. POST /v1/render with {url}. Robots.txt is honored and private addresses are refused. JSON in, JSON out, errors included. Pay per request in USDC; no account, no API key.

Render any web page in a real headless browser and return a PNG screenshot. Supports viewport width/height (320-1920) and full-page capture. Ideal for agents doing visual verification, UI monitoring, archiving or content review.

Summarize any web page. Give a URL; Bob reads the page with Firecrawl and returns an 80-word summary with key points. Typical response 3 to 6 seconds. If the page cannot be read in time you get an error and are not charged.

Semantic search API for Telegram. Search across 1M channels, 150K chats, and 100K bots using hybrid search (embedding similarity + BM25 keyword matches).

Read any web page as clean text: give a URL, get the visible text rendered in a real browser, with the title and final URL. For scraping, RAG and research.

Plain web search. Returns ranked results (title, URL and a short snippet) for a query, up to 10, optionally limited to a publish-date range with since and until (YYYY-MM-DD). No AI-written answer, so it is fast: typically under a second. If it cannot return results you get an error and are not charged.

Extract a public PDF (by HTTPS URL or base64) into clean Markdown - headings and tables preserved via layout-aware parsing, plus title/author/page count/date metadata and a real token count. Text content itself is never generated or altered, only its structure is inferred. Try GET /pdf/sample. Part of the AgentIndex content kit (pdf, web-read, extract, summarize, detect-language) - see GET /capabilities.

Website screenshot: give a URL, get a 1280x800 JPEG of the page rendered in a real browser, with its title, final URL and SHA-256.

Tavily's Penny Search: The Clearest Working Case in the x402 Census, Under Scrutiny. Tavily sells web search to AI agents for one cent a call, and in the last 30 days, 302 wallets bought it 36,958 times. Start with what Tavily is, because it matters. This is not an anonymous contract deployed last month. Tavily is an established AI web-search company with a real domain, Terms of Use, and a Privacy Policy. Its core business is search-as-API for LLM applications. What it added is an x402 endpoint at x402.tavily.com/search, where any agent can buy a single search in USDC on Base wi. One payment returns the full text, and the creator is paid as it is used.

CAPTCHA solving API — reCAPTCHA, Turnstile, hCaptcha, image captchas, and more.

Edges provides LinkedIn automation actions for data extraction, search, and discovery. Extract profiles, companies, posts, jobs, events, and more. Search across LinkedIn and Sales Navigator.

Web scraping, crawling, and structured data extraction for LLMs.

Xynaptic Tech News v2 — structured events (AI/LLM, GPU, quantum computing, last 3h): importance, lifecycle, entities, sectors, multi-source verification, agent-ready actions. Refreshed every 2 hours.

ScalpStream cryptocurrency screener: coins ranked by RSI, ATR%, VWAP distance and 30-minute momentum with a Fear & Greed macro overlay — which coins show technical setups, not raw price quotes (impersonal research publication)

Web search: search the web and get ranked results with page content. Up to 10 results with title, URL, snippet and publish date, plus clean full-page Markdown for the top 3 by default. Up to 5 queries per call, merged and de-duplicated. Each query is routed by Jev to the best specialised source (code, facts, news, prices, weather). No account, no API key. Try GET /search/sample. Part of the AgentIndex content kit (pdf, web-read, extract, summarize, detect-language) - see GET /capabilities.

Live YouTube scraping

Live Instagram scraping

Fetch any public web page or PDF and return clean main-content Markdown for AI agents / LLMs (boilerplate, nav and ads removed) plus title & metadata. CJK-aware; optional Simplified<->Traditional (incl. Hong Kong / Taiwan) conversion. Respects robots.txt. $0.002 per call, USDC on Base (x402). Failed extractions are not charged.

Live YouTube scraping