What Enterprises Really Ask
Before Trusting AI with Consumer Research

2.1 Individual reconstruction — “How far is it from the real person?”

Over half the concerns we recorded land on “fidelity.” But the word conceals significant variation — teams asking whether synthetic consumers are “realistic enough” turn out to be asking three fundamentally different questions.

The insights lead at an FMCG group drew the line immediately. He'd tested multiple AI tools and found the industry's go-to quality check — asking the same question repeatedly and seeing if the answer holds — entirely beside the point:

Consistency is a technical metric with established benchmarks. What he's asking for — whether the model can reconstruct how a real person actually makes decisions — is what the field calls fidelity. It's a business metric, and the industry has no agreed-upon way to measure it.

A luxury research director in Switzerland approached from a different angle. His team relies on depth interviews to surface the contradictions and irrational impulses that actually drive purchase decisions. His concern is that AI smooths away precisely the messiness that makes insight useful:

Preferences and attitudes leave traces and are tractable to simulate. But an internet platform's research lead found that once you cross category boundaries, the picture shifts entirely:

This isn't the familiar attitude-versus-behavior gap. It's that a single person runs fundamentally different decision-making processes depending on the category — and whether simulation technology can follow someone across those switches remains unresolved.

Some teams pushed the questioning beyond individual accuracy into temporal and group-level concerns. An edtech company ran several rounds of testing and found the same synthetic consumer producing different answers over time:

In group settings, a different worry emerged. When multiple synthetic consumers were assembled into a focus group, the uniformity of their responses was striking:

If every synthetic consumer is permanently stable and highly consistent, what a researcher holds isn't a population — it's a polished mean. The variance within groups, the drift of individuals over time — the things traditional research builds expensive longitudinal panels to capture — are precisely what AI is most likely to flatten out.

2.2 Capability boundaries — “Which research scenarios work, which don't?”

The second line of questioning skips “how close” and goes straight to testing limits against specific use cases.

A food company tried using synthetic consumers to screen new flavors and hit a wall immediately: the model has no body.

An internet company's UX team ran into the same barrier. They need the immediate responses of users swiping, tapping, hesitating, abandoning — and the synthetic consumer has never interacted with their product:

It's not just the outcome that matters — the interaction process itself carries information:

New product teams face an even more extreme version. When the product hasn't launched yet, the synthetic consumer has no experience to draw on — only analogical reasoning:

A beauty brand hit yet another boundary when testing packaging visuals. The AI's choices appeared to follow its own aesthetic pattern rather than reflecting how real consumers evaluate design:

These scenarios share a common structure: they require first-hand experiential cognition — the body's sensory response, the fingertips navigating an interface, the genuine reaction to encountering something for the first time. Simulation technology cannot provide this in principle. No one has mapped where these boundaries lie; each company is discovering them through trial and error.

2.3 Knowledge reliability — “Can you trust what it says?”

The third line of questioning moves past “how close” and “where does it work” to a more fundamental risk: whether the information a synthetic consumer outputs is itself reliable.

LLM hallucination — output that sounds coherent and logically consistent but is entirely fabricated — is a known problem. It's easy to catch in everyday contexts, but once professional domains are involved, the stakes rise sharply:

The operative phrase is “inside the industry.” In one food R&D evaluation, a synthetic consumer's description of a testing method raised immediate alarm:

A similar case surfaced in a discussion of baking formulations, where the synthetic consumer confused the application contexts of a specific ingredient:

In traditional research, human respondents getting facts wrong isn't unusual — you filter them out and continue. But when the same error comes from a synthetic consumer, nobody's first instinct is to “filter out and retry.” The instinct is to question whether the entire system is trustworthy. The same factual mistake: from a human, it's sampling noise; from a machine, it's systemic risk. That asymmetry in tolerance is itself worth examining.

At this point in our conversations, the dynamic shifted. Enterprises stopped only probing for weaknesses and started offering paths forward — could domain knowledge be injected into the model?

A healthcare platform went further, arguing that the depth of industry-specific training data requires collaboration from within the sector:

Others proposed connecting the model to the enterprise's existing proprietary data:

Of the three lines of questioning in this section, this is the only one where enterprises shift from challenger to co-builder. The first two probe the ceiling of what simulation can do; this one begins discussing how to raise it.