Products SEO & GEO Agent Paid Ads Agent Website Agent Conversion Agent
How it works Pricing FAQ Blog Book a call

AI rank trackers: what they can and can't measure

Updated · 7 min read

Want help applying this to your business? Talk it through on a free 30-minute call.

Book a call

What does an AI rank tracker actually measure?

A sample. The vendor writes a list of questions, often called synthetic prompts (made up by the tool, not typed by your customers). It sends them to ChatGPT, Gemini, Google's The AI-written summary Google shows above some search results, with links to the pages it drew from. More and others on a schedule, then reads each answer for your name, your links and your rivals. Every number on the dashboard comes from those runs.

Number on the dashboardWhat it really isTrust it?
Visibility or mention rateShare of the tool's answers that named youYes, as a trend, if each question runs many times
Share of voiceYour mention rate next to your rivals'Yes, on the same condition
CitationsYour pages shown as sources in those answersYes, for the answers collected
Average position or "AI rank"Where you sat in a list that reshuffles almost every runNo
Prompt or search volumeThe vendor's estimate; no AI company publishes itOnly if the vendor shows how it's made
SentimentThe tool's own reading of the toneRead a few answers yourself

The mention rate is the useful part. Position and volume are the weak parts.

Why is there no stable rank in AI answers?

Because the same question gets a different answer almost every time. In SparkToro's January 2026 study, 600 volunteers ran 12 prompts through ChatGPT, Claude and Google's AI a combined 2,961 times. The authors put the chance that ChatGPT or Google's AI repeats the same list of brands, in any two of 100 answers, at under 1 in 100. The same order: closer to 1 in 1,000. BrightLocal's September 2026 study of local searches agrees: result sets from repeat runs overlapped only 23% on ChatGPT, 21% on AI Mode and 33% on AI Overviews.

Three more things move the answer:

"AI Mode and AI Overviews may use different models and techniques, so the set of responses and links they show will vary." (Google Search Central: AI features and your website)

What held steady was who got named. Across 994 answers to those 142 prompts, Bose, Sony, Sennheiser and Apple each appeared in 55–77% of them. The authors conclude that visibility percentages across many prompts are likely "decent proxies" for how brands show up in real AI answers, while position in a list means little. The study discloses that one author works for an AI tracking startup. BrightLocal saw the same in local searches: a business named once came back in about half of later runs.

So count how often you're named across many runs. Ignore where you sit in any one answer.

Can a tracker see how many people ask ChatGPT a question?

No. No AI company shares how often people ask a given question, so any "prompt volume" on a dashboard is the vendor's estimate. Ask how it's made. What the platforms do share, free, about your own site:

AI toolWhat you getWhat you don't get
Google AI Overviews and AI ModeSearch Console's Generative AI performance report: impressions by page, country, device and date. Launched June 2026; all sites by August 31, 2026The questions behind the impressions; the Gemini app
Microsoft Copilot and Bing's AI summariesBing Webmaster Tools' AI Performance report (public preview since February 2026): citations per page, plus "grounding queries". Since June 2026, also in preview: Citation Share, your percentage of all citations for a grounding queryPlacement: Bing counts citations "without indicating placement or presentation within a specific answer"
ChatGPTYour claimed business listing's insights (beta since November 2026): mentions and website clicks over the past 28 daysIndividual prompts or conversations; local businesses can claim only US listings

Bing's grounding queries are not your customers' exact words. Bing defines them as "the key phrases the AI used when retrieving content," and says the data "represents a sample of overall citation activity." Google's free tool that shows which searches bring people to your site and flags pages Google can't index. More setup: Search Console for a small business.

Two more real numbers sit in your own systems:

For Claude, Perplexity and the Gemini app, a tracker or your own test is how you see the answers.

How big a change in your numbers is real?

Bigger than most dashboards suggest. A mention rate is a sample, and small samples swing by chance. Basic probability (a binomial calculation) shows how much:

Answers checkedIf you're truly named in 20%Usual range by chance (95%)
4083–13
1002012–28
2004029–51

So a move from 8 to 11 out of 40 is noise. Believe a change when it holds for two or three months, or when the sample is large. SparkToro's author goes further: to know an AI's set of recommendations, he says, ask the same question at least 60–100 times.

Is an AI rank tracker worth paying for?

It depends on how many questions and AI tools you need covered.

Before you pay, ask the vendor:

  1. How many times does each question run per check? One run is a snapshot, not a rate.
  2. Can I add questions in my customers' own words?
  3. Can I read the raw answers and their sources?
  4. Where does the "volume" number come from?
  5. Which city and account settings do the runs use?
  6. Does the report lead with an average position? If so, treat that number as noise.

Deciding whether to pay for Generative engine optimization: work that helps AI assistants like ChatGPT, Gemini and Perplexity find, trust and mention your business. More work at all: is GEO worth paying for?.

Example

Illustrative cases. Numbers are invented for the example.

A Denver roofer whose "AI rank" dropped (US dollars)

His $100-a-month tracker shows his average position falling from 2 to 5. His mention rate across 120 answers held at 31%. Nothing changed but the order of the lists. He keeps watching the rate, plus Bing's citation count, which is free.

A Calgary dental office with no tracker (Canadian dollars)

It can't claim a ChatGPT listing yet. Search Console's AI report shows its implant page earning The number of times your ad or listing was shown, whether or not anyone clicked. in Google's AI answers each month, and analytics shows a few visits tagged chatgpt.com. With "How did you hear about us?" on the intake form, it knows what it needs for $0.

An HVAC company in six cities (US dollars)

Five services in six cities make 30 questions. Across four AI tools, run three times each, that's 360 checks a month. By hand, that's not realistic. A tracker earns its fee here; the company picks one that shows raw answers and accepts customers' own wording.

FAQ

Can I track my ranking in ChatGPT?

Not as a fixed position. Track how often ChatGPT names you across many runs. In the US, a claimed listing also shows mentions and clicks.

Do AI rank trackers use real customer questions?

Mostly their own. AI companies don't hand out customers' prompts; OpenAI's help center says businesses don't receive individual prompts or conversations.

Does Search Console show AI Mode data?

Yes. Its Generative AI report shows AI Overviews and AI Mode impressions by page, for every site since August 2026. It doesn't show the questions.

Are AI rank trackers accurate?

They record what the AI said. What they infer is weaker: a position in a reshuffling list, or a volume no AI company publishes.

Different for you?

Keep learning

NextGEO maturity model: a stage-by-stage check for small businessesFour stages of AI search readiness, a free yes-or-no check for each, and the next fix, built on what Google, Microsoft and OpenAI publish.

Do it yourself

Does ChatGPT recommend your business? A 20-question testA free test any owner can run to see whether ChatGPT names their business, which competitors it names instead, and why.

Ask us one question

One line is enough. We reply by email.

Sources

  1. SparkToro: AIs are highly inconsistent when recommending brands or products (January 2026)
  2. BrightLocal: Local AI Visibility Study (September 2026)
  3. OpenAI Help Center: Searching the web with ChatGPT
  4. Google Search Central: AI features and your website
  5. Google Search Central Blog: Search Generative AI performance reports in Search Console (June 2026)
  6. Bing Webmaster Blog: Introducing AI Performance in Bing Webmaster Tools Public Preview (February 2026)
  7. Bing Blog: New AI Visibility Insights in Bing Webmaster Tools (June 2026)
  8. OpenAI Help Center: Setting up your business on ChatGPT
  9. OpenAI: Introducing Businesses in ChatGPT (November 2026)
  10. OpenAI Help Center: Publishers and Developers FAQ