Non-determinism

Non-determinism is the tendency of an AI system to return different answers to the same prompt on separate runs.

Source: https://contentcucumber.com/aeo-glossary/non-determinism/

Topic: Measuring visibility. Also called: Answer variability, Response variance


Why it matters

Because one answer is a single sample, a brand that appears in one run can be absent from the next.

Example (illustrative, not a client result)

The same question asked five times names a brand in three answers and leaves the brand out of two.

What to check

Run each tracked prompt several times, record each run, and report the share of runs in which your brand or page appears.

What this does not tell you

More runs narrow the uncertainty without removing it, and results still differ by engine, location, and date.

Sources

Evidence type: Documented concept. Sources checked on 2026-11-21

Related terms