web-search-and-content

Global news article search by GDELT — normalized fulltext search across worldwide media (query syntax: phrases, OR, sourcecountry, theme, tone) returned as a clean snake_case envelope.

Clean web content extraction — any URL to markdown + text + metadata

Search Product Hunt for new products, SaaS launches, and developer tools. AI agent API for market research and competitive intelligence. Accepts USDC payments on Base and Solana

Targeted web scrape: pass a CSS selector and get back only the matching elements from a fully JavaScript-rendered page. Each element returns its tag, text content and every HTML attribute. Use it to pull prices, links, table rows, headlines or any repeated structure without parsing a whole document. Returns a match count so an agent can tell an empty page apart from a broken selector.

Read any live web page as clean, LLM-ready text. Renders JavaScript in a real browser, then strips navigation, ads and boilerplate. Use it when a plain HTTP GET returns empty or garbled HTML: single-page apps, dynamic feeds, or content that only appears after scripts run. Returns markdown, plain text or cleaned HTML plus the upstream HTTP status. Page content is third-party data and is flagged untrusted so an agent treats it as input, never as instructions.

Fetch one public web page and return its readable content as clean text or markdown, with JavaScript executed, so the result reads like the page a human sees. The retrieval half of research: pair it with /search to go from a query to grounded page text. Returns the content, its length, the final URL and the HTTP status. Truncate with max_chars.

Structured extraction: give a JSON Schema plus a URL or raw text, get back JSON matching the schema.

Instant AI research on any topic powered by Gemini 3.5 Flash with live Google Search grounding — answers come with cited sources. Ask about science, tech, crypto, history, or anything else. Can analyze images and summarize webpages from URLs. Max 180 character prompts. $0.10 per query.

Fetch any public web page and return clean, readable Markdown with navigation, ads, and boilerplate stripped. For agents that need article text or documentation as Markdown.

Researches YouTube videos from their real transcripts: pass video URLs in the task or in `urls`, or describe a topic and it finds relevant videos. Returns what you asked for, then per-video thesis, key claims and quotes, each cited to a transcript timestamp [n @ mm:ss]. If... | BlindOracle by Craig M. Brown (craigmbrown.com) - counterparty-risk infrastructure sold to autonomous AI agents; self-built multi-agent framework (42+ agents); ERC-8004 agent passport #60979; paid via x402 in USDC on Base

Clean main-content extraction of a single buyer-supplied URL via Firecrawl, wrapped in the BlindOracle trust envelope. Thin extraction tool; no data inventory held. | BlindOracle by Craig M. Brown (craigmbrown.com) - counterparty-risk infrastructure sold to autonomous AI agents; self-built multi-agent framework (42+ agents); ERC-8004 agent passport #60979; paid via x402 in USDC on Base

Bing search API - live Bing SERP for a query: Bing search engine results returned as ranked organic hits with title, URL, domain and snippet, localised by location and language. A bing serp api for agents: search Bing, live Bing web search for grounding, RAG and cross-engine lookup beyond Google.

Extract structured text, tables, and metadata from any PDF URL. Returns page-by-page text content, detected tables as JSON arrays, and document metadata (title, author, page count). No PDF library or OCR setup needed — pay per extraction. AI agent API for document intelligence and data extraction

OpenAI-compatible chat completions over x402, answered by Claude Sonnet 4.6 — send a messages array and get an assistant reply for Q&A, reasoning, agent planning, coding help, summarization, extraction, and classification. Body is OpenAI chat.completions-shaped ({model?, messages:[{role,content}], max_tokens?, temperature?}); response is a chat.completion object. Flat $0.06; inputs capped ~6KB, max_tokens 1024; no streaming in v1.

Keyless attested web scrape: ?url= → { title, markdown, word_count }. $0.02 Base USDC (agent scrape band).

Extract title and common meta tags from caller-held HTML — first-party local utility for agent preflight and proven micro-utils expansion. Returns deterministic machine-readable JSON for $0.002 USDC via x402 on Base. Execution is first-party, local-only, stateless, and memory-only with no paid upstream, no input retention, no web search, no live RPC, and no mediagen. Results are advisory; the caller owns authorization, budgets, and production controls.

Extract href links from caller-held HTML without network access — first-party local utility for agent preflight and proven micro-utils expansion. Returns deterministic machine-readable JSON for $0.002 USDC via x402 on Base. Execution is first-party, local-only, stateless, and memory-only with no paid upstream, no input retention, no web search, no live RPC, and no mediagen. Results are advisory; the caller owns authorization, budgets, and production controls.

Quick web answer with citations (Exa upstream): ask one factual or current question and get a concise synthesized answer plus source URLs and publication dates. Optimized for fast lookups and agent loops; use /llm-research for a deeper multi-section research report, reasoning, image analysis, or webpage summarization. Keyless, pay-per-call, cached by query.

Give this API a link to any website's sitemap.xml file and it will fetch and parse it, returning every URL found inside. If the sitemap links to other sitemaps (called sitemap indexes), it will follow and extract those too. Each URL is returned with any extra information available, such as when the page was last updated and how often it changes. Useful for SEO audits, content inventories, broken link checks, and competitive research.

Give this API a web address and it will visit that page, then hand back everything an SEO professional needs to know: the page title, meta description, meta keywords, robots instructions, canonical link, H1/H2/H3 headings, how many links are on the page, and the HTTP status code. No setup required — just paste a URL and get structured data back in under two seconds.

Checks how well a Shopify store's products show up when AI shopping assistants such as ChatGPT, Gemini, Perplexity, Grok, and Copilot search for products, and reports the store's rank and its closest competitors. Searches Shopify's real Global Catalog - the same product index AI assistants read from.

Check sitemap and robots hints fast to see how a site exposes crawlable structure for $0.01 USDC. Call when you need this bounded result without an API key or subscription. Returns machine-readable JSON via x402 on Base or Solana. Limitation: results cover only the supplied input or one bounded public endpoint at request time; callers must verify before acting.

One-call website intelligence report and website content extraction API for agents: $0.01 USDC returns page metadata, readable signals, docs map, pricing hints, contacts, forms, feeds and crawl guidance—not general web search and not a multi-URL crawl farm.

Extract clean title, host, and bounded main text from one public URL for $0.01 USDC. Call when you need readable page content for routing, RAG prep, or summarization—not general web search and not a multi-URL crawl. Returns structured page metadata via x402. No API key, no subscription.