Where each AI assistant gets its answers
Each one searches the web before it answers, but not the same web. Fix the source, and the answer follows.
| Assistant | Where its web answers come from | Crawler to let in | Listing that feeds it |
|---|---|---|---|
| Gemini | Google's Search index (Google) | Googlebot; Google-Extended also controls the Gemini app | Google Business Profile, through Google Maps (Gemini Help) |
| Copilot | Bing (Microsoft) | Bingbot (Bing) | Bing Places (Bing) |
| Perplexity | Its own index of over 200 billion URLs (Perplexity) | PerplexityBot (Perplexity) | No listing program in its docs; Yelp pages get cited (Yelp) |
| Claude | Its own web search, with Brave Search among its listed providers (Anthropic) | Claude-SearchBot and Claude-User (Anthropic) | No listing program in its docs |
| ChatGPT | Its own crawler plus partner search providers, Microsoft among them (OpenAI) | OAI-SearchBot | Yelp and your ChatGPT listing (US): see how to get ChatGPT to recommend you |
So your Google profile feeds Gemini, Bing Places feeds Copilot, and only your own website reaches all five.
How to rank in Perplexity
Let its crawler in. Perplexity builds its own index, so ranking on Google doesn't carry over by itself.
"To ensure your site appears in search results, we recommend allowing PerplexityBot in your site's robots.txt file and permitting requests from our published IP ranges listed below." (Perplexity Docs)
- Check your firewall too. Perplexity says a site behind a web application firewall such as Cloudflare "may need to explicitly allow Perplexity's bots" (Perplexity Docs).
- Changes take a day. Robots.txt changes can take "up to 24 hours" to apply (Perplexity Docs).
- Blocking isn't airtight. Its second agent, Perplexity-User, visits pages when someone asks a question, and "generally ignores robots.txt rules" (Perplexity Docs).
How to show up in Gemini
Rank on Google and keep your Your free business listing on Google Search and Maps: hours, photos, reviews, services and contact details. More complete. Gemini has no separate index to get into.
- Web answers come from the Google Search index, which Google provides "to the model at prompt time" (Google).
- Place answers (who's open, how far, what rating) come from Maps: "Gemini uses public information from Google Maps" to find businesses and show their hours, ratings and websites (Gemini Apps Help).
One trap: blocking the Google-Extended token in robots.txt also stops Google from using your pages to ground Gemini app answers (Google). It doesn't touch normal search:
"Google-Extended does not impact a site's inclusion in Google Search nor is it used as a ranking signal in Google Search." (Google)
How does Claude search the web?
It runs a live search when a question needs current information, then cites what it used. "Every response includes citations" (Claude Help Center).
Anthropic has three bots and ties two of them to search visibility (Anthropic):
| Bot | What it does | If you block it |
|---|---|---|
| Claude-SearchBot | Indexes pages for search | "may reduce your site's visibility and accuracy in user search results" |
| Claude-User | Fetches a page when a user asks | "may reduce your site's visibility for user-directed web search" |
| ClaudeBot | Collects training data | Signals that your future pages should be left out of training |
Anthropic's subprocessor list names three web search providers: Brave Search, Parallel Web Systems and turbopuffer (Anthropic Trust Center). It doesn't say which one serves a given answer.
Copilot: Bing's index and Bing Places
Copilot answers from Bing. Microsoft says Copilot "may fetch information from the Bing search service" when the web helps the answer (Microsoft Learn).
"Bing and Copilot search experiences rely on the same core crawling, indexing, and ranking foundation as traditional search." (Bing Webmaster Guidelines)
For local questions, Microsoft points to Bing Places to keep your address, hours and phone "eligible for inclusion in AI-generated responses" (Bing Webmaster Blog). Setup is in Bing Places and Copilot.
One checklist for all of them
| Step | What to do | Who it helps |
|---|---|---|
| 1 | In robots.txt, allow Googlebot, Bingbot, OAI-SearchBot, PerplexityBot, Claude-SearchBot and Claude-User | All |
| 2 | Ask your host or CDN whether a bot-blocking rule is on; allow the vendors' published IP ranges | Perplexity, ChatGPT |
| 3 | Complete Google Business Profile, Bing Places and Yelp, with the same name, address and phone | Gemini, Copilot, all |
| 4 | One page per service, with the key facts near the top | All |
| 5 | Skip special AI files | Google says it doesn't use them |
Step 4 is Bing's own advice: "Place essential information near the top of the URL" (Bing Webmaster Guidelines). On step 5:
"You don't need to create new machine readable files, AI text files, markup, or Markdown to appear in Google Search (including its generative AI capabilities), as Google Search itself doesn't use them." (Google Search Central)
None of this guarantees a mention. Bing: "GEO does not guarantee grounding or citations in AI experiences" (Bing Webmaster Guidelines).
How to tell if it's working
| Where you appear | Where to look |
|---|---|
| Google AI Overviews and AI Mode | Search Console's Generative AI performance report: impressions and pages, live for all sites since August 31, 2026 (Google). It doesn't cover the Gemini app. |
| Copilot and Bing's AI summaries | Bing Webmaster Tools' AI Performance report, in public preview since February 2026: citations and the queries behind them (Bing) |
| Perplexity, Claude, Gemini app | No owner report in their docs. Ask the same questions each month, the way the 20-question ChatGPT test does. |
And ask every new caller how they found you.
Example
A roofer behind a bot-blocking firewall
The site ranks on Google and shows in Gemini, but never in Perplexity or Claude. The host's firewall blocks "AI bots" by default. Allowing PerplexityBot, Claude-SearchBot and Claude-User fixes access; Gemini never needed it.
A Toronto physiotherapy clinic
Strong Google profile, no Bing Places listing. It shows in Gemini's place answers, not Copilot's. Importing the Google profile into Bing Places makes it eligible once Bing's publish cycle ends.
An accountant who blocked Google-Extended
He wanted his articles out of AI training. His Google rankings didn't move, but the Gemini app can no longer ground answers in his pages. He keeps the block on his articles folder only and allows the service pages.
Different for you?
- ChatGPT is the one your customers use: how to get ChatGPT to recommend your business.
- You never set up Bing: Bing Places and Copilot.
- You're deciding which bots to block: should you block AI crawlers?
- Google's AI answers matter most: AI Overviews and AI Mode for local services.
- Someone quoted you a Generative engine optimization: work that helps AI assistants like ChatGPT, Gemini and Perplexity find, trust and mention your business. More retainer: is GEO worth paying for?
- You'd rather have it done and tracked: SEO & GEO Agent.