How to Measure AI Search Visibility When There Is No Rank Report

Ask your analytics how many patients found you through ChatGPT last month. It has no idea. There is no impression count, no position, no click-through rate, because the thing you want to measure happened inside a conversation you were never part of. That is the awkward position every operator is in right now: a channel that visibly matters, and an instrument panel that reads zero.

The reflex is to wait for the tooling to catch up. That is a mistake, because the measurement problem here is not temporary. You can still measure AI search visibility today, just not the way you measured rankings, and the method is old enough to be boring: take a sample.

Why rank tracking cannot measure AI search visibility

Rank tracking worked because search results were a public, ordered list. Anyone could look at the same page and agree on what position three meant. An assistant’s answer is none of those things. It is written once, for one person, and it may be worded differently for the next person who asks the same question an hour later.

The size of the shift is measurable at the edges, even when the middle is invisible. Pew Research Center tracked the actual browsing of 900 US adults across nearly 69,000 Google searches in March 2025: when an AI summary appeared, people clicked a traditional result on 8 percent of visits, against 15 percent when no summary appeared, and clicked a link inside the summary itself on just 1 percent. The traffic did not move to a different page. For most of those searches it simply stopped existing.

Worth saying plainly, because the forecasts have been wilder than the facts: in February 2024 Gartner predicted traditional search volume would fall 25 percent by 2026, and that call remains contested. Predictions about the whole market were never going to tell you anything about your category anyway. What you need is a reading on your own business, and no analyst report will ever contain one.

Score one axis: cited, named, or absent

The measurement gets tractable the moment you stop trying to recreate a rank number and accept a cruder scale. For any question a patient asks, there are only three outcomes worth recording.

Cited means the answer named you and attached the source, so the reader has a door. Named means you appear in the text with nothing to click, which is real but weaker: they now know you exist and will leave from somebody else’s page. Absent means the answer had room for two or three names and none of them was yours. There was no click to lose.

Weighting a citation at double a bare mention is a judgment call, not a law, and you should feel free to change it. What matters is that the scale stays the same every month, because you are measuring a direction, not a truth.

The visibility climb

1. 1

   Absent

   The answer had room for two or three names and used none of them on you.

2. 2

   Named, no link Start here

   You are in the sentence. The reader still leaves from somewhere else.

3. 3

   Cited

   Your name and your page, inside the answer. This is the rung that sends people.

4. 4

   Cited first, by name

   You are the source the answer is assembled from. Rare, and it decays if the page goes stale.

Build the probe set, then run it

A probe set is a fixed list of the questions your patients actually ask, phrased the way they would say them to an assistant rather than the way they would type them into a search box. “Who is taking new patients in Scarborough” rather than “family doctor Scarborough”. Ten is the right number: enough to see a pattern, few enough that you will genuinely re-run it next month.

Mix the types deliberately. Discovery questions where you are one of many. Qualified questions where a good fit should surface you. Commercial questions asked close to the decision. And two brand questions, because being absent from an answer about your own name is a diagnosis all by itself.

The discipline that makes this worth doing is the same one that makes an eval suite worth building inside a product: fix the questions first, score them the same way every time, and resist the urge to improve the test when you dislike the result. A probe set you keep rewording is a probe set that can never show you a trend.

It is a loop, not a dashboard

One run tells you almost nothing. It is the second run that turns a number into information, and the discipline is in what happens between them.

Take the single worst result, not all four, and give that question a page that answers it plainly in the first breath, with the concrete facts a machine can lift: what it costs, who it is for, where you do it, when you are open. Then leave it alone until next month. One closed gap per loop is slow, and it is also the only version of this that actually gets done. The answer engine optimization work is nothing more exotic than that, repeated.

The number you are chasing is not a benchmark. It is your own last run.

What this cannot tell you

Four honest limits, because a method that oversells itself gets abandoned the first time it disappoints.

It is a sample, not a census. Ten questions from your account tell you about ten questions from your account. Assistants personalise by history and location, so your run and your patient’s run are not the same experiment.

It is noisy. The same question can return different names an hour apart. This is exactly why the trend across months matters and a single run does not, and why re-running after a bad result to get a nicer one is self-deception rather than measurement.

It does not measure revenue. Being cited is not being chosen. The bridge between them is a “how did you hear about us” field on your contact form, which costs nothing and is the only place this channel ever shows up as money.

And it cannot manufacture a reason to cite you. An answer engine compresses a market down to its clearest few sources, which makes a genuine difference more valuable, not less. Measurement will tell you that nobody is quoting you. It will not tell you that there was nothing quotable.

One case where the honest answer is to skip this: if your patients reach you almost entirely through physician referral or a public waitlist, and none of them has ever opened an assistant to find a clinic like yours, this belongs on a watch list rather than this quarter’s plan. Run the ten questions once to confirm that, then leave it for six months.

What to do Monday

Write your ten questions. Run them once against one assistant, log the three verdicts in a spreadsheet, and put the date and the model name at the top. Take the worst answer and write one page that answers that question properly, and add “how did you hear about us” to your contact form while you are in there. Then put a repeating half hour in the calendar for the same day next month.

Two runs is when this starts paying. The first gives you a baseline you did not have, and the second tells you whether anything you changed actually moved an answer.

---

Not sure which ten questions matter for your business? Book a free consult and we will build your probe set with you, run the first pass live, and show you exactly which pages are costing you the citation.