web-search-and-content

Fetch Web Page as Text: fetch any public URL as clean readable text Executed deterministically by the AmanChain node against live consensus state (real blocks, pools, balances) — paid per call via x402, settled in USDC on Base. Input: JSON body {"serviceId":"aman-web-fetch","request":" "}. No account, no API key.

Extract all hyperlinks from a web page. Returns internal/external classificat...

Extract clean markdown from any URL. Full JS rendering via Playwright available.

URL Metadata Extract: URL title, description, Open Graph image and canonical metadata Executed deterministically by the AmanChain node against live consensus state (real blocks, pools, balances) — paid per call via x402, settled in USDC on Base. Input: JSON body {"serviceId":"aman-url-meta","request":" "}. No account, no API key.

Ask any factual or market-research question. Searches the live web with Tavily and Exa, extracts the most relevant page with Firecrawl, and returns a short synthesized answer with source URLs. Typical response 4 to 8 seconds. If it cannot answer in time you get an error and are not charged.

Product and price from any public product page, even without structured data: uses the page's schema.org/OpenGraph data when present, otherwise AI reads the page text for name, brand, price, currency, availability and SKU. Says which method was used. url is the product page's address (https://...). Respects robots.txt; not charged if it isn't a product page. ?url=...

Read the text in an image (OCR): screenshots, photos of signs, receipts, slides, scanned pages. Returns the text in reading order with line breaks, and whether any text was found. JPEG, PNG, GIF or WebP up to 5 MB from a public URL.

Scrape JavaScript-heavy web pages (single-page apps, React/Vue sites, dashboards) to clean Markdown in a real headless browser: scripts run, then the rendered page is converted. Returns title, Markdown and links. url is the page address (https://...). Use /markdown for ordinary pages and PDFs (cheaper). Private addresses are blocked; failures are not charged.

Live web search API for AI agents, open-sources tier: fresh results from Wikipedia, Hacker News, DuckDuckGo instant answers and Stack Overflow, merged, de-duplicated and ranked (title, URL, snippet, date). q is the search words; limit caps the results (default 10). Not a full-web index yet: it moves to full-web results (and price) when a premium index is connected; the provider field says which. ?q=...&limit=10

Find the AI-ready docs for any library or API: checks the project's docs site (from its npm, PyPI, crates or Go metadata) or any company domain (docs., developers., /docs) for llms.txt and llms-full.txt files, with titles, sizes and page counts, plus homepage and repository. ?library=hono or ?site=stripe.com

Every page address a website publishes: reads robots.txt, follows its sitemaps (and sitemap indexes), and returns the URLs with last-modified dates, newest first, optionally only under one path (e.g. /blog/). Also returns the robots rules that apply to crawlers. Plan a crawl or spot new pages cheaply. ?url=https://example.com&path=/docs/

Summarize a URL, raw text or HTML at the length you request - short, medium or long - with the source noted. Neutral and factual, no invented facts. Try GET /summarize/sample. Part of the AgentIndex content kit (pdf, web-read, extract, summarize, detect-language) - see GET /capabilities.

Extract structured data from a URL or raw text into strict JSON matching a schema you provide. Fields the content doesn't support come back null - never an invented or approximate value, and an unmatchable schema returns an explicit error. Try GET /extract/sample. Part of the AgentIndex content kit (pdf, web-read, extract, summarize, detect-language) - see GET /capabilities.

Turn a small website, or one section of it, into clean Markdown: starts from your URL, finds pages from the sitemap or by following links on the same site, obeys robots.txt, and returns up to 10 pages (title, Markdown, address) in one call. Great for docs, blogs and company sites. ?url=https://example.com/docs/&maxPages=10&path=/docs/

Web search with a cited answer for AI agents (RAG), open-sources tier: finds pages via Wikipedia, Hacker News, DuckDuckGo and Stack Overflow, reads the top ones (robots.txt respected) and writes a concise cited answer, plus the pages read. q is your question; pages (1-5, default 3) is how many pages to read. Moves to full-web search (and price) when a premium index is connected. ?q=question&pages=3

Search academic papers across Europe PMC (PubMed, PMC, preprints) and Crossref (all disciplines), merged by DOI: title, authors, year, journal, DOI, abstract, citation count and a free full-text link when open access. q is the topic or title words; sort is relevance, recent or cited; from_year and open_access=true narrow the results. ?q=retrieval augmented generation&limit=10

Extracts OG tags, canonical URL, title, and meta description from any web page. Useful for link previews, SEO audits, and content enrichment.

Accepts a natural language compatibility question and returns structured compatibility data. Designed for AI agents receiving unstructured user queries. **Examples:** - "Does the Anker 737 fast charge the iPhone 15 Pro?" - "What cases fit t

Extract every hyperlink on a web page as structured JSON: resolved absolute URL, anchor text, internal-vs-external classification and nofollow flag, up to 2000 unique links. The building block for agent crawlers that need to decide where to go next, plus broken-link sweeps, backlink and SEO analysis, and site mapping.

Web content extraction and search. Get clean markdown from any URL or search results.

60 minutes of the browser dashboard for humans: live whale positioning, signals and an AI brief that refreshes on its own

Grounded web search: question → answer + citations, powered by Bedrock Web Search.

Extracts content from web pages by parsing and retrieving data from specified URLs.

Scrapes all images from the given URL. Extracts images from img, svg, picture/source, link, and video elements including inline SVGs, base64 data URIs, and standard URLs.