Non-determinism
Non-determinism is the tendency of an AI system to return different answers to the same prompt on separate runs.
Source: https://contentcucumber.com/aeo-glossary/non-determinism/
Topic: Measuring visibility. Also called: Answer variability, Response variance
Why it matters
Because one answer is a single sample, a brand that appears in one run can be absent from the next.
Example (illustrative, not a client result)
The same question asked five times names a brand in three answers and leaves the brand out of two.
What to check
Run each tracked prompt several times, record each run, and report the share of runs in which your brand or page appears.
What this does not tell you
More runs narrow the uncertainty without removing it, and results still differ by engine, location, and date.
Sources
- Anthropic: glossary, temperature (Platform documentation)
Evidence type: Documented concept. Sources checked on 2026-11-21