web-search-and-content

Find pages semantically similar to a given URL.

Get an AI-generated answer to a question grounded in live web search results.

Neural and keyword web search. Optional category filter: company, research paper, news, pdf, github, tweet, personal site, linkedin profile, financial report.

Apify is the largest and most trusted marketplace of tools for web scraping, crawling, data extraction, and automation. Use these tools, called Actors, to extract structured data from social media, e-commerce sites, search engines, maps, travel sites, or any other website. Turn the open web into a real-time data source for your research, lead generation, and monitoring.

Extract article / main content from any URL or PDF to clean, LLM-ready Markdown (web scraper / reader / html-to-markdown) — strips scripts, nav, ads, and boilerplate while preserving headings, links, lists, tables, code blocks, and blockquotes; extracts the text layer from PDFs. Returns Markdown body, title, word count, and a quality grade so agents can read articles and documents without a browser or paid scraping service.

Extract article / main content from any URL or PDF to clean, LLM-ready Markdown (web scraper / reader / html-to-markdown) — strips scripts, nav, ads, and boilerplate while preserving headings, links, lists, tables, code blocks, and blockquotes; extracts the text layer from PDFs. Returns Markdown body, title, word count, and a quality grade so agents can read articles and documents without a browser or paid scraping service.

Extract and classify all hyperlinks from a web page — internal vs external using eTLD+1 domain matching. Returns up to 200 internal and 200 external links with counts. No web crawler setup needed. Accepts USDC payments on Base and Solana

Extract clean, readable text from any web page — removes navigation, ads, scripts, and boilerplate. Dual-engine extraction with JS-rendered page fallback for SPAs and dynamic content. Returns content with title, author, word count, language, and reading time. No headless browser or scraping library needed. Accepts USDC payments on Base and Solana

Fetch any URL and return clean Markdown with metadata (title, byline, excerpt, siteName, lang). Uses Mozilla Readability + Turndown. Built for AI agents doing RAG, content summarization, and research workflows. Drop-in alternative to Jina Reader and Firecrawl, with pay-per-call USDC pricing via x402. Accepts payment on Base or Solana — either network works.

Exa neural search - AI-native web search with structured results and citations

AI text embeddings - vector representations for semantic search and RAG pipelines, pay per request with USDC

Web page to clean markdown. Converts any URL into LLM-ready markdown plus structured metadata — a keyless alternative to Firecrawl.

Search PyPI for Python packages — find libraries, frameworks, and developer tools. AI agent API for Python ecosystem research. Accepts USDC payments on Base and Solana

Search Semantic Scholar — 200M+ academic papers with citation graph. AI agent API for literature review and research intelligence. Accepts USDC payments on Base and Solana

Paid book chapter (x402): Automate the Boring Stuff with Python: What Is Programming. Unit of a larger practical-skills library; free catalog at /library/discovery.json. Book slug: automatetheboringstuffwithpythonnew. Response format: Markdown (.md) for agent parsing. USDC on Base via Coinbase CDP facilitator. Free teasers and discovery.json require no payment.

Comprehensive AI content analysis — sentiment scoring (-1.0 to 1.0), topic classification, named entity extraction, content type detection (news/blog/docs/tutorial), and credibility assessment. Returns structured analysis ready for immediate use. No LLM integration needed. Accepts USDC payments on Base and Solana

Extract structured data from any unstructured text into your own JSON Schema — structured-data / information extraction, text-to-JSON, LLM data enrichment. You supply the schema; the LLM returns a matching object. Works for contacts, invoices, events, product specs, medical records, legal clauses, resumes — any shape. Returns the extracted object plus token usage; unfound fields are omitted or null.

Extract structured data from invoice or receipt text using Claude Haiku — returns vendor, invoice number, dates, line items, subtotal, tax, total, and currency as clean JSON so agents can automate accounts-payable, expense processing, and bookkeeping from raw invoice text.

Extract structured data from any unstructured text into your own JSON Schema — structured-data / information extraction, text-to-JSON, LLM data enrichment. You supply the schema; the LLM returns a matching object. Works for contacts, invoices, events, product specs, medical records, legal clauses, resumes — any shape. Returns the extracted object plus token usage; unfound fields are omitted or null.

Extract structured data from invoice or receipt text — or directly from an invoice URL (PDF, HTML, or plain text, fetched and parsed server-side) — using Claude Haiku: returns vendor, invoice number, dates, line items, subtotal, tax, total, and currency as clean JSON for accounts-payable, expense processing, and bookkeeping automation.

List all AI models on Bittensor. OpenAI /v1/models compatible. Drop-in: just change base_url to gateway.spraay.app/bittensor/v1

Scrape a URL and convert to clean markdown

Detect technologies used on a website (POST variant)

Fetch and parse any RSS 2.0 or Atom feed URL and return structured articles with title, link, description, author, publish date, and categories — so agents can monitor content sources, build news pipelines, and process any feed without building their own XML parser.