web-search-and-content

Global news article search by GDELT — normalized fulltext search across worldwide media (query syntax: phrases, OR, sourcecountry, theme, tone) returned as a clean snake_case envelope.

Read any web page as clean, LLM-ready markdown — managed unlocking with residential IPs, IP rotation, automated CAPTCHA solving and full JavaScript rendering; overcomes blocks. For RAG ingestion, agent browsing and access-controlled pages. web read, fetch page, scrape, markdown, unblock, javascript rendering, rag ingestion, agent browsing

Extract tabular data from messy text or HTML using Claude Haiku — detects columns and rows in unstructured content and returns clean structured JSON (columns + rows) so agents can turn pasted tables, HTML tables, and delimited text into usable data in one call.

Fetch any article or web page and extract clean readable text stripped of navigation, ads, and boilerplate — returns the main content body, word count, estimated reading time, detected language, and key sentences so agents can read the web without a browser or third-party scraping service.

Fetch a URL and detect the full technology stack from HTTP response headers, HTML meta tags, cookies, and script patterns — returns CMS, framework, CDN, server, analytics, and security tool detections so agents can profile any web target without a browser.

Extract named entities from text using Claude Haiku — people, organizations, locations, dates, emails, URLs, money amounts, and products — returned as structured typed arrays so agents can pull structured signals out of unstructured text in one call.

Extract named entities from text using Claude Haiku — people, organizations, locations, dates, emails, URLs, money amounts, and products — returned as structured typed arrays so agents can pull structured signals out of unstructured text in one call.

Extract tabular data from messy text or HTML using Claude Haiku — detects columns and rows in unstructured content and returns clean structured JSON (columns + rows) so agents can turn pasted tables, HTML tables, and delimited text into usable data in one call.

Fetch a URL and detect the full technology stack from HTTP response headers, HTML meta tags, cookies, and script patterns — returns CMS, framework, CDN, server, analytics, and security tool detections so agents can profile any web target without a browser.

Fetch any article or web page and extract clean readable text stripped of navigation, ads, and boilerplate — returns the main content body, word count, estimated reading time, detected language, and key sentences so agents can read the web without a browser or third-party scraping service.

Event extraction / event parsing — turn any caption, announcement, listing, or page text into a normalized calendar event via Claude Haiku. Resolves relative dates ("this Saturday 7pm") against post time + timezone, handles all-day/multi-day, and returns title, start/end, venue, address, city, price, organizer, url. Purpose-built for structured event data (no schema to define — unlike generic extractors); pairs with /event-classify (cheap filter) and /calendar/ics (publish step).

One call combines domain availability, heuristic value appraisal, and TLD pricing into a single acquisition brief — tells an agent whether a name is available, what it's worth, and what it costs across TLDs, concurrently and with graceful partial-failure handling.

Extract structured data from resume/CV text using Claude Haiku — returns name, contact info, skills, work experience, and education as clean JSON arrays so agents can automate applicant screening, candidate databases, and recruiting workflows from raw resume text.

Extract structured data from resume/CV text using Claude Haiku — returns name, contact info, skills, work experience, and education as clean JSON arrays so agents can automate applicant screening, candidate databases, and recruiting workflows from raw resume text.

Fast real-time news scan across 44+ curated domains (configs/search_domain_profiles.json), every item source-attributed. Settlement proof: ProofOfSettledOutcome (kind 30120, data/proof_settled_outcomes.jsonl). The quick-scan tier below research.topic-deep-researcher's slower, citation-grade report.

Structured extraction: give a JSON Schema plus a URL or raw text, get back JSON matching the schema.

Full-text search across all of Hacker News (via the Algolia HN API). Search stories or comments by keyword, sorted by relevance or by date (newest first). Filter by tags (story/comment/ask_hn/show_hn/poll) and by author. Each hit: title, URL, author, points, comment count, story/comment text, created time, and canonical HN URL. Net-new vs news.hn-top (curated feeds) and news.search (general news).

Live news search. Returns recent headlines with title, URL, snippet, publisher source, relative age, and a breaking-news flag — real-time coverage past any model training cutoff. Supports count (1-20), offset, country (2-letter), and freshness (pd=past day, pw=past week, pm=past month, py=past year). Use for current events, market-moving developments, monitoring, and "what happened with X" questions. For general web results see /api/search/web; for Hacker News specifically see /api/news/hn-top.

Live web search. Returns ranked results with title, URL, snippet description, site name, and page age — fresh information past any model training cutoff. Supports count (1-20), offset for paging, country (2-letter, e.g. US), freshness (pd=past day, pw=past week, pm=past month, py=past year, or a YYYY-MM-DDtoYYYY-MM-DD range), and safesearch (off/moderate/strict). Use for current events, fact verification, finding documentation, and research. Independent search index. For news-specific results with sources and timestamps see /api/news/search.

Extracts and analyzes YouTube video transcripts into a structured research report with cited timestamps, not a generic summary. Settlement proof: ProofOfSettledOutcome (kind 30120, data/proof_settled_outcomes.jsonl). Shares the deep-research methodology of research.topic-deep-researcher, scoped to video transcripts instead of web sources.

Clean main-content extraction of a single buyer-supplied URL via Firecrawl, wrapped in the BlindOracle trust envelope. Thin extraction tool; no data inventory held.

Reddit subreddit feed scraper — the latest posts from any subreddit (r/<name>) for AI agents, sorted by hot, new, top, rising, or controversial with an optional time window. Returns each post’s title, author, score, comment count, permalink, external link + domain, flair, NSFW flag, and timestamp. No login, no Reddit API key. Monitor communities, track trending posts, and feed social signals to agents.

Extract all links from markdown: inline, reference, autolinks, images. Returns array of {type, text, url, title}. Use url param or ?text=.... Built for AI agents link auditing, broken-link detection, sitemap crawling.

Search Stack Overflow questions via Stack Exchange API. Returns title, score, answer_count, is_answered, accepted_answer_id, tags, view_count, link, created_at, owner. Use ?q=YOUR_QUERY plus optional and tag=python and site=stackoverflow|serverfault|superuser and limit=10. Built for AI coding agents finding proven solutions and Q and A.