Tutorials

Why ChatGPT Can't Find Your Company Website

Sep 18, 2026

In one line

Five reasons ChatGPT cannot find your website, from blocked AI crawlers and unquotable content to missing structured data, with a self-check for each.

When ChatGPT cannot answer questions about your company, the cause is rarely that your brand is too small. In most cases the website simply does not exist in a form AI search engines can read and quote. The five causes below run from basic to advanced, and each includes a self-check so you can locate the exact blocker.

Reason 1: AI crawlers cannot reach your website

ChatGPT's answers come from two sources: the model's training data, and a live web search performed at the moment of answering. Both depend on the same precondition, which is that AI crawlers can fetch your website.

The major AI crawlers all use publicly documented User-Agent names: GPTBot (OpenAI, for model training), OAI-SearchBot (OpenAI, for the ChatGPT search index), ClaudeBot (Anthropic), PerplexityBot, and CCBot (Common Crawl). If your robots.txt blocks them, your content never enters the AI's field of view. OAI-SearchBot is the one that decides whether you appear in ChatGPT search results: blocking GPTBot only opts you out of model training, while blocking OAI-SearchBot is what removes you from ChatGPT search.

Google-Extended deserves a separate note. It is not a crawler that fetches pages. It is a control token in robots.txt that decides whether Google may use your content for AI training, and the actual crawling is still performed by Googlebot.

Many website templates and security plugins block unfamiliar crawlers by default, without the site owner ever knowing. Another common problem is a missing sitemap, which leaves crawlers without a complete list of your pages.

Self-check: open yourdomain.com/robots.txt in a browser and search for the crawler names above, looking for matching Disallow rules. Also check whether the User-agent: * group contains a site-wide rule such as Disallow: /, because any crawler not listed by name falls back to that default group. Then open yourdomain.com/sitemap.xml and confirm the file exists and lists your main pages.

Reason 2: Your content has no quotable statements

When an AI engine answers a question, it extracts complete, self-contained sentences. A quotable statement is a sentence that explains a fact on its own, without needing any surrounding context.

A slogan like "Experience exceptional service today" carries no information, so AI has nothing to quote. A sentence like "Example Trading Co. is a Hong Kong software company that provides cloud accounting systems" is the kind that can be cited.

Self-check: open a random page on your site and ask of each sentence, if this one sentence were extracted alone, would a reader know who you are, what you do, and where you operate. If every sentence only makes sense with the text around it, AI cannot make sense of it either.

Reason 3: Your pages have no structured data

Structured data is standardized markup, usually written in JSON-LD inside the page source, that lets machines understand page content precisely. For an SME website, the essential set is Organization (company details), FAQPage (question-and-answer content), and BreadcrumbList (page hierarchy).

FAQPage markup is especially worth adding. It turns your Q&A content into a structure machines can read directly, which makes it easier for AI engines to extract and cite.

Self-check: right-click on your web page, choose View Page Source, and search for application/ld+json. If there are no matches, the page contains no structured data at all.

Reason 4: Your brand information is scattered and inconsistent

AI engines cross-reference multiple sources to confirm a company's basic facts. If your website says "Example Trading Company Limited", your social pages say "Example Trading Co.", and a business directory still shows your old address, AI cannot be sure these all refer to the same company, and it would rather not answer.

Hong Kong companies that use both a Chinese and an English name are especially exposed. The two names circulate separately on different platforms, and no single page connects them in one complete sentence.

Self-check: copy out the company name, address, and phone number shown on your website, social pages, and business directories, then compare them side by side. Your About page should state the Chinese name, the English name, and your line of business together in one full declarative sentence.

Reason 5: Your site is too new and lacks outside corroboration

AI engines prefer to cite information that other sources corroborate. A site that just launched, with no external websites mentioning it, gives AI no basis for trust no matter how well the content is written. Model training data also has a cutoff date, so a very new site may simply not be included yet.

Self-check: type site:yourdomain.com into a search engine and see how many pages are indexed. Then ask ChatGPT's search feature or Perplexity about your brand name and watch which sources they cite. If every citation is a third-party site and your own website never appears, the problem is indexing and corroboration.

FAQ

Where do ChatGPT's answers come from?

They come from the model's training data and from a live web search run at the moment of answering. If your site has not been crawled or indexed, neither source contains your content.

What is GPTBot?

GPTBot is OpenAI's crawler for model training. OpenAI also operates OAI-SearchBot (for ChatGPT search) and ChatGPT-User (for live user browsing), and the three are controlled separately in robots.txt, so blocking GPTBot does not remove you from ChatGPT search.

What is llms.txt?

llms.txt is a proposed plain-text file placed in a website's root directory. It summarizes the site's key content in Markdown for large language models to read, and it complements robots.txt rather than replacing it.

What does AEO mean, and is it related to the customs AEO program?

In this context AEO stands for Answer Engine Optimization, the practice of making your content easy for AI engines to cite, sometimes also called GEO (Generative Engine Optimization). It merely shares an acronym with the customs Authorized Economic Operator program and a fashion retailer's stock ticker, which is why many practitioners simply say AI visibility instead.

How long do fixes take to show results?

There is no fixed timetable. Each AI engine refreshes its data on its own schedule, so the practical approach is to ask each tool the same question at regular intervals after making a fix.

See your site the way AI sees it

All five checks above can be done by hand, but working through robots rules, structured data, and content format page by page takes real time. The free AEO Auditor (ai.ud.hk/aeo-auditor) runs an AI visibility check on any URL you enter. Seeing how your website looks to AI first makes it much easier to decide which fix to start with.