Home / AI agents / Search and AI-visibility data for AI agents
For AI builders · checked Oct 27, 2026
Search and AI-visibility data for AI agents
Keyword demand, what ChatGPT, Perplexity, Gemini and Google AI answer, and whether a brand is named: typed JSON and Markdown your agent can call over MCP or REST, priced per result. Real output below.
What this is, and what it is not
Your agent can already fetch a web page. What it cannot do on its own is know how often people search for something, how hard it is to win, or what ChatGPT, Perplexity, Gemini and Google's AI Overview tell buyers. Wrenfield Data tools answer those questions as small typed JSON rows (Markdown where an LLM benefits from it), priced per result, callable over MCP or plain REST. There is no subscription and no seat; every call can be capped.
We do not sell page scraping or a general web-search API. The most-used AI tools on the Apify Store are Apify's own RAG Web Browser and Website Content Crawler, and the search APIs below are strong at that job. This page is for the data they do not give you.
Pick the tool for the question
| Question the agent asks | Tool | Price | |
|---|---|---|---|
| How many people search for X? (volume, CPC, 12-month trend) | Keyword Search Volume | $0.004 per keyword ($4/1k) | |
| How hard is it to rank, and what is the intent? | Keyword Difficulty Checker | $0.005 per keyword (intent is a separate small event) | |
| What do ChatGPT, Perplexity, Gemini and Google AI Mode answer? (Markdown + sources) | AI Answer Scraper | $0.015 per answer ($15/1k) | |
| Is my brand named in those answers, in what position, and who is named instead? | AI Search Visibility Tracker | $0.04 per prompt check (from 2026-11-02: $0.06) | |
| What does Google's AI Overview say, and which pages does it cite? | Google AI Overview Scraper | $0.0025 per query | |
| What questions do people also ask around a keyword? | People Also Ask Scraper | $0.0055 per keyword search |
Free-plan prices from the Apify API when this page was built (Oct 27, 2026); paid Apify plans pay less automatically. Every tool also exists as a Markdown spec and in one OpenAPI file.
Real output, copied from real runs
Each block below is a row from a run we made, with the run id and date. Fields are trimmed where marked (the real rows are longer), and nothing is invented. These are single snapshots: AI answers vary between runs.
Keyword Search Volume: demand for a keyword, with CPC and 12-month history
An agent that plans content, ads or a product launch asks how many people search for this? and gets one typed row per keyword.
Tool: wrenfield-data/keyword-search-volume · real run dCawxuudSmCsLABfu, 2026-10-23 (UTC date). Google Ads live source (paid Apify plans). Trimmed: 3 of 12 months shown. Free-plan runs use the keyword-database source and are capped at 10 keywords per run.
{
"keyword": "crm software",
"type": "keyword",
"seed_keyword": null,
"location": "United States",
"location_code": 2840,
"language": "English",
"language_code": "en",
"search_volume": 201000,
"cpc": 37.13,
"competition": "LOW",
"competition_index": 4,
"low_top_of_page_bid": 7.14,
"high_top_of_page_bid": 51.57,
"keyword_difficulty": null,
"search_intent": null,
"trend": {
"monthly": 174,
"quarterly": 124,
"yearly": null
},
"monthly_searches": [
{
"date": "2025-10",
"year": 2025,
"month": 10,
"search_volume": 165000
},
{
"date": "2025-11",
"year": 2025,
"month": 11,
"search_volume": 110000
},
{
"date": "2025-12",
"year": 2025,
"month": 12,
"search_volume": 90500
}
],
"found": true,
"source": "google_ads_live",
"data_updated_at": null,
"scraped_at": "2026-10-23T01:55:44Z"
}AI Answer Scraper: what an AI engine says, as Markdown, with its sources
An agent asks what do AI assistants tell buyers about this?. The answer comes back as Markdown (tables and links kept) plus the cited URLs and domains, so you can pass it straight into a prompt.
Tool: wrenfield-data/ai-answer-scraper · real run TylqMurh3I9ytKpOK, 2026-10-19 (UTC date). Single snapshot of one prompt on one engine; answers change from run to run. Trimmed: answer cut to 420 characters, 3 of 10 citations shown; the plain-text copy of the answer, model name, organic_results and fan_out_queries (empty here) are left out.
{
"prompt": "What is the best CRM for a small business?",
"engine": "perplexity",
"engine_name": "Perplexity",
"status": "ok",
"answer_markdown": "**For most small businesses, HubSpot CRM is the best starting point**: it offers a free entry point, contact management, deal pipelines, and marketing/service features in one ecosystem.[4][6] Choose **Zoho CRM** instead if keeping costs low and gaining broad functionality matter most; choose **Pipedrive** if your main priority is a simple, sales-focused pipeline.[2][4]\n\n| Best for | CRM | Why choose it |\n|---|---|---...",
"answer_word_count": 274,
"citations": [
{
"url": "https://www.salesforce.com/crm/crm-for-small-business/best-crm/?bc=OTH",
"domain": "salesforce.com",
"title": "Best Small Business CRM in 2026"
},
{
"url": "https://www.pcmag.com/picks/the-best-small-business-crm-software",
"domain": "pcmag.com",
"title": "The Best Small Business CRM Software We've Tested for 2026"
},
{
"url": "https://www.techradar.com/best/best-crm-for-small-business",
"domain": "techradar.com",
"title": "Best small business CRM of 2026"
}
],
"citation_count": 10,
"cited_domains": [
"salesforce.com",
"pcmag.com",
"techradar.com"
],
"brand_entities": [],
"country": "United States",
"language": "English",
"response_time_secs": 4.3,
"note": null,
"scraped_at": "2026-10-19T16:26:42Z"
}AI Search Visibility Tracker: is a brand named, where, and who is named instead
An agent that watches a brand asks does ChatGPT or Perplexity recommend us for this question? and gets booleans and positions instead of prose to parse.
Tool: wrenfield-data/ai-search-visibility-tracker · real run LmlfGvZe4IAZmhGPg, 2026-10-23 (UTC date). Input was brand HubSpot, competitors Salesforce and Pipedrive, one prompt, Perplexity. A single run, not a ranking. Trimmed: 13 of 32 output fields shown.
{
"type": "check",
"prompt": "What is the best CRM for a small business?",
"engine_name": "Perplexity",
"status": "ok",
"brand": "HubSpot",
"brand_mentioned": true,
"brand_position": 1,
"brand_sentiment": "positive",
"your_domain_cited": true,
"your_cited_urls": [
"https://blog.hubspot.com/sales/all-in-one-crm"
],
"competitors_mentioned": [
"Salesforce",
"Pipedrive"
],
"first_mentioned_brand": "HubSpot",
"cited_domains": [
"salesforce.com",
"pcmag.com",
"blog.hubspot.com"
]
}Google AI Overview Scraper: the AI Overview text as Markdown, plus references
An agent that audits search results asks does Google show an AI Overview for this query, and what does it say?
Tool: wrenfield-data/google-ai-overview-scraper · real run ih6TApypUMgZG9Kts, 2026-10-23 (UTC date). UK desktop result, single snapshot. Trimmed: 10 of 21 output fields shown, text cut to 380 characters.
{
"query": "how to apply for a uk passport",
"has_ai_overview": true,
"ai_overview_markdown": "To get a UK passport, apply online through the [GOV.UK Passport Service](https://www.gov.uk/apply-renew-passport) or use a paper form via the Post Office.\n\n### Step-by-Step Application Process\n\n- **Choose your application method:** \n\t- **Online:** The cheapest and fastest way to apply.\n\t- **By paper:** Pick up a form from a local Post Office or request one online.\n- **Prepare y...",
"ai_overview_word_count": 313,
"reference_count": 10,
"referenced_domains": [
"gov.uk",
"iasservices.org.uk"
],
"people_also_ask": [
"What documents do you need to get an UK passport?",
"What is the quickest way to apply for an UK passport?"
],
"related_searches": [
"Apply for UK passport renewal",
"UK passport application form online"
],
"serp_features": [
"ai_overview",
"organic",
"people_also_ask",
"related_searches"
],
"status": "ai_overview"
}Bulk Keyword Difficulty Checker: difficulty and intent as plain fields
Small, flat and typed: easy for an agent to filter ("only keywords under 30") without reading prose.
Tool: wrenfield-data/keyword-difficulty-checker · real run KT5Da2AyOmSUBmMDT, 2026-10-27 (UTC date). Full row, nothing trimmed.
{
"keyword": "how to start a podcast",
"keyword_difficulty": 15,
"difficulty_level": "easy",
"search_intent": "informational",
"search_intent_probability": 1,
"secondary_intents": [],
"location": "United States",
"language": "English",
"found": true,
"scraped_at": "2026-10-27T22:11:47Z"
}Connect your agent in a minute
- MCP (Claude, Cursor, VS Code, ChatGPT apps, n8n): add this URL as a remote MCP server and sign in to Apify. It loads only the AI Answer Scraper, so the agent has one tool to choose from:
For several tools in one server (answers, brand checks, volume, difficulty):https://mcp.apify.com?tools=wrenfield-data/ai-answer-scraper
Clients without OAuth can sendhttps://mcp.apify.com?tools=wrenfield-data/ai-answer-scraper,wrenfield-data/ai-search-visibility-tracker,wrenfield-data/keyword-search-volume,wrenfield-data/keyword-difficulty-checkerAuthorization: Bearer <APIFY_TOKEN>. Copy-paste configs for each client are on the AI agents page, and the repo is wrenfielddata/wrenfield-mcp (MIT). - REST from your own agent loop: one POST returns the rows. This is a complete function tool (tested against the saved real rows above):
The same pattern works forimport os, requests def run_actor(actor, payload, max_usd=0.50): """Run an Apify Actor and return its result rows. Apify stops the run at max_usd.""" r = requests.post( f"https://api.apify.com/v2/acts/{actor.replace('/', '~')}/run-sync-get-dataset-items", params={"maxTotalChargeUsd": max_usd}, headers={"Authorization": f"Bearer {os.environ['APIFY_TOKEN']}"}, json=payload, timeout=300) r.raise_for_status() return r.json() def keyword_demand(keywords, country="United States"): """Tool for your agent: monthly Google searches and CPC per keyword, as a Markdown table.""" rows = run_actor("wrenfield-data/keyword-search-volume", {"keywords": keywords, "location": country}) out = ["| keyword | searches / month | CPC (USD) |", "|---|---|---|"] for r in rows: if r.get("type") == "keyword": vol = f"{r['search_volume']:,}" if r.get("found") else "no data" out.append(f"| {r['keyword']} | {vol} | {r.get('cpc') or '-'} |") return "\n".join(out)ai-answer-scraper(fieldanswer_markdown) andai-search-visibility-tracker(fieldsbrand_mentioned,brand_position,competitors_mentioned). - Try a prompt: "Get US search volume for 'crm software' and 'best crm for small business', then check whether Perplexity recommends HubSpot for 'best CRM for a small business' and tell me which keyword to write about first."
What an agent task costs
| What the agent does | Cost (Apify Free-plan prices) | How it adds up | |
|---|---|---|---|
| Size demand for 50 keywords | $0.20 | 50 × $0.004, keyword-database source; live Google Ads data adds a per-request fee, see the tool page | |
| Ask 4 buyer questions on 2 engines | $0.12 | 8 answers × $0.015 | |
| Brand check: 10 prompts on 2 engines | $0.80 now, $1.20 from 2026-11-02 | 20 checks × $0.04 ($0.06 from 2026-11-02) | |
| Difficulty for 100 keywords | $0.50 | 100 × $0.005, difficulty only |
Failed or empty results are not charged on most tools; check each tool page. Add maxTotalChargeUsd to REST calls (or pass call options over MCP) so a looping agent cannot overspend. Apify's free plan includes $5 of platform credit each month with no card; free-plan keyword runs are limited to 10 keywords per run.
Where the money goes in an AI-agent stack
| What agents buy | Typical tools and list prices | Our role | |
|---|---|---|---|
| Page content for RAG (a URL or a search turned into Markdown) | Apify RAG Web Browser: $0.00348 per search + $0.00228 per fetched page (Free plan). Apify Website Content Crawler: about $0.20 per 1,000 pages on raw HTTP. Firecrawl: search is 2 credits per 10 results. Tavily: $0.008 per credit pay as you go. Exa: $4 to $12 per 1,000 searches. | Not what we sell. Use these for page text and call us next to them. | |
| Raw Google results | Serper: $1.00 per 1,000 searches down to $0.30 at volume. SerpApi: $25 a month for 1,000 searches. Brave Search API: $5 per 1,000 requests. | We are not a general SERP API. We return the Google features that matter for SEO agents (People Also Ask, AI Overview). | |
| Demand and competitiveness data | Subscription SEO suites and their APIs. | Keyword volume, CPC, difficulty and intent per result, from $0.004 per keyword with no subscription. | |
| What AI assistants say about a topic or brand | ChatGPT answer scrapers on Apify list at $2 to $8 per 1,000 results (apifystats census, Oct 27, 2026); brand visibility dashboards from $99 a month per domain. | $0.015 per answer from ChatGPT, Perplexity, Gemini, Google AI Mode, Claude as Markdown with citations, and brand checks with positions. Pricier than single-engine scrapers; the extra is the Markdown, citations and brand fields. |
Prices are list prices read from the sources below on Oct 27, 2026; vendors change them. Our tools complement these services rather than replace them.
Limits you should know
- AI answers are samples. The same prompt gives a different answer next time. For decisions, check several prompts and engines and look at the trend (our 7,910-answer study shows how much answers differ between engines).
- Keyword volume is Google Ads data (ranges and rounding apply to very small keywords), and keyword difficulty is a modelled 0-100 score, not a promise.
- We do not host the MCP server. Apify runs the endpoint and bills per result; you need an Apify account (free plan available).
- No reviews or usage numbers on this page because we have not earned a number worth quoting yet. The run ids above are the evidence.
Machine-readable
llms.txt · llms-full.txt · tools as Markdown · OpenAPI 3.1 · MCP configs · REST pricing and quickstart
FAQ
What do AI-agent developers buy from the Apify Store?
Mostly page content: Apify's own RAG Web Browser (search plus page text as Markdown) and Website Content Crawler lead the AI category by users. Wrenfield Data sells the other half: search demand, keyword difficulty, what AI engines answer and whether a brand is named.
Can an AI agent call these tools without me writing glue code?
Yes. Every public tool is an MCP tool through Apify's MCP server (one URL, OAuth or a bearer token). Each tool exposes its input schema and output fields, so the agent can call it directly.
How do I stop an agent from overspending?
Add maxTotalChargeUsd to REST calls, or set call options over MCP. Apify stops the run when the cap is reached. Empty and failed results are not charged on most tools.
Is the output ready for an LLM?
The AI Answer Scraper and the Google AI Overview Scraper return Markdown fields (answer_markdown, ai_overview_markdown) with links and tables kept. The keyword tools return small flat typed rows that are easy to turn into a Markdown table, as in the code above.
Is there a free way to try it?
Apify's free plan includes $5 of monthly platform credit with no card. Free-plan keyword runs are capped at 10 keywords per run. For a no-account look at AI visibility, use the free check on this site.
Sources
- Use Apify: best Apify Actors for RAG (prices checked Oct 20, 2026)
- Apify MCP server (GitHub)
- apifystats: AI & agent tools on the Apify Store (census, Oct 27, 2026)
- Devshot: best search APIs for AI agents, cost per 1k (updated Oct 2026)
- Semrush AI Visibility Toolkit pricing ($99 a month per domain)
- serp.fast: web search API cost per query
Third-party prices are list prices read on Oct 27, 2026; check the source before you buy. Our prices are read from the Apify API when this page is built (Apify Free-plan tier). Trademarks belong to their owners; Wrenfield Data is not affiliated with any vendor named here.
Give your agent a data source
Start on the Apify free plan ($5 monthly credit, no card), paste the MCP URL above, and ask your agent a question from the table.
Create a free Apify account MCP configs Free AI check (no account)