Web & Data

Scrape a URL and convert to clean markdown

Fact-check a claim by searching for evidence online

Detect technologies used on a website (POST variant)

Fetch and parse any RSS 2.0 or Atom feed URL and return structured articles with title, link, description, author, publish date, and categories — so agents can monitor content sources, build news pipelines, and process any feed without building their own XML parser.

Fetch any public URL and extract structured metadata — Open Graph tags, Twitter Card tags, canonical URL, title, description, favicon, article author/date, JSON-LD structured data, and content type — so agents can preview, classify, and enrich links without building their own scraper.

Fetch and parse any XML sitemap or sitemap index file — returns URLs with their priority, change frequency, and last modified date, follows sitemap indexes one level deep (first 3 child sitemaps), and auto-discovers the sitemap from robots.txt or common paths when given a bare domain — so agents can enumerate site content for crawling, indexing, and SEO analysis.

Look up domain registration metadata via RDAP — returns registrar, creation/expiry dates, nameservers, status flags, and an actionability score so agents can assess domain trustworthiness or availability risk.

Fetch and parse a domain's robots.txt file — returns all crawl rules by user-agent, sitemap URLs, crawl delay settings, and checks whether a specific path is allowed or blocked for any bot — so agents can respect crawl policies and locate sitemaps before scraping.

Fetch and parse any RSS 2.0 or Atom feed URL and return structured articles with title, link, description, author, publish date, and categories — so agents can monitor content sources, build news pipelines, and process any feed without building their own XML parser.

Fetch any public URL and extract structured metadata — Open Graph tags, Twitter Card tags, canonical URL, title, description, favicon, article author/date, JSON-LD structured data, and content type — so agents can preview, classify, and enrich links without building their own scraper.

Fetch metadata for any npm package — download counts, latest version, all versions list, dependencies, maintainers, repository URL, license, and a health score based on maintenance signals — so agents can evaluate dependencies, audit package ecosystems, and assess supply chain risk.

Query the Internet Archive Wayback Machine to check if a URL has ever been archived, get the closest snapshot to a given date, retrieve the most recent capture, and return archival history stats — so agents can access historical web content, verify past content claims, and recover deleted pages.

Renders a webpage exactly as a real browser would, including all its scripts and dynamic content, then takes a picture of it. You can capture just the visible area or the whole scrollable page, choose the screen size, wait for slow-loading images to finish, and hide cookie banners or popups before the picture is taken.

Fetch a PDF by URL and extract its text as JSON. Input: url (public http/https pointing to a PDF). Returns {url, pages, word_count, text}. Bounded to the first 50 pages; 3 MB max.

Tiny rollup - counts by risk category + 5 worst current deviations

OFAC SDN sanctions screen for a name / entity / wallet (?name=)

Full funding rates — all assets, all exchanges, signal analysis

Per-country sovereign economic / default-risk score (?country=<name or ISO3>)

Discover RTP robots. Filter by capability, chain, price, status.

Trace an HTTP redirect chain to its final destination without downloading page bodies. Returns every hop (URL + status), the final URL, and safety warnings — link-safety grounding for agents before they visit or cite a URL. Clean JSON.

Search Reloadly's gift card catalog (300+ brands, 14,000+ products/denominations across countries). Returns each product's id, brand, country, denomination range or fixed amounts, and sender fee/discount — everything needed to build a POST /api/giftcard/quote call.

Live grid carbon intensity, deterministic. Answers "how clean is the grid right now", "gCO2 per kWh in Germany", "cleanest hour to run a job today". Current intensity + forward curve (to 48h) + cleanest and dirtiest slots, from NESO (GB national + 14 DNO regions) and energy-charts/Fraunhofer ISE (DE FR NL BE AT ES IT NO). No LLM, no key. Pair with /api/energy/compute-window for full job scheduling.

Real-time web search for AI agents — search the web and get ranked SERP-style results as clean JSON: title, URL, snippet, relevance score, optional LLM-generated answer. Find up-to-date information online — latest news, current events, finance. Date, domain and exact-phrase filters.

Read any web page or article: fetch up to 5 URLs in one batch call and extract the main content as clean, LLM-ready markdown or plain text. Convert webpages to markdown, scrape page text, pull article content for RAG ingestion and AI agent context.