Designing AI for Adoption: From Pilots to Products

Why do so many AI pilots stall? Mastercard’s Mara Pometti believes the issue isn’t merely technical, it’s experiential. AI scales only when there is adoption, and adoption is powered by experience. If interactions with AI feel cranky, irrelevant, or misaligned with users’ expectations, engagement collapses and pilots die — and even the smartest model can’t recover a broken experience.
Close up of Mara Pometti, Mastercard on stage at World Congress 2025 talking about improving AI adoption

The real barrier to scale 

Most organisations can build sophisticated AI, but far fewer manage to turn it into something people genuinely want to use — something that integrates into daily life and delivers ROI. At DataIQ’s World Congress, Mara Pometti, Mastercard’s Vice President of Agentic Experience Strategy, argued that adoption, not accuracy or performance, is the real test of value. 

“Every poor AI interaction is a broken relationship. When AI feels irrelevant, customers churn, and revenue drops. This isn’t a UX problem. It’s a P&L problem.” – Mara Pometti, Vice President Agentic Experience Strategy, Mastercard 

Drawing on her experience building AI products at IBM, McKinsey QuantumBlack and now at Mastercard—where she is leading the design and development of a cutting-edge agentic platform— she outlined how designing the AI experience for users (the way systems interact with humans) determines whether pilots move beyond proof of concept. 

“To scale AI, we don’t need products that work ‘well enough’; we need meaningful experiences people want to come back to.” 

 

Four dimensions of AI experience 

Pometti describes AI experience as the bridge between intelligence and outcome, the layer that makes capability usable. She breaks it down into four human dimensions that determine whether people stay engaged: 

  1. Specificity: Does it understand me and my context? 
  2. Attention: Does it prioritise what matters to my goals? 
  3. Trust: Is it safe, explainable, and reliable? 
  4. Agency: Does it return control to me for important decisions? 


If any of these is weak, adoption decays even when the system performs technically well.
An LLM can hit 95% accuracy on a benchmark, but if the output feels off, unhelpful or not specific, the user won’t stay. Technical performance isn’t the same as human alignment and adoption hinges on the latter. 

 

Start with the outcome 

Pometti’s team begins every build by defining first the golden outcome, — what the user expects — and then works backwards to the technical design choices and architecture that guarantees it. 

For example, a request like plan next quarter’s cash flow fails without persistent context and memory: which quarter, which previous conversion thread, which data? A good system retrieves earlier sessions and resolves “Q3” correctly because its memory and reasoning layers are designed for that specific user’s context. 

The takeaway: start with what success looks like for the user, then engineer backwards. 

 

Building trust and control 

Trust is not a statement but a system. Pometti’s team begins by mapping potential errors and risks to understand how to mitigate them and build the right controls and evaluation mechanisms. Without that feedback loop to ensure trust and safety, no pilot can scale. 

As AI agents begin acting on behalf of users, organisations must also define how much autonomy they should have. Pometti developed a framework to identify agency tiers by use case: some agents can observe and propose; others can act only within strict limits. Clear boundaries and escalation paths are designed from the outset to preserve human agency. Pometti noted that delegation tiers, user intent recognition, and trust, are also a core components of Mastercard’s Agent Pay.   

 

Leadership Lessons 

Pometti underscores that scaling AI isn’t only about better AI systems but better experiences that can be built by:  

  • Designing for adoption from day one. 
  • Treating trust, context, and user control as product features. 
  • Measuring ROI through experience metrics like task completion, return rate, and satisfaction, not model performance. 

 

Join DataIQ to access the full article and all of Pometti’s insights. 

DataIQ 100 Alumni 2026 on stage at the 2026 Congress discussing recognition and leadership.

DataIQ 100 Class of 2026: Turning Recognition into Responsibility

Daniel Susskind at DataIQ Congress 2026

The Future of Work in the Age of AI

Rightmove CEO Johan Svanstrom and CDO Steve Pimblett at Congress 2026.

Turning Data into Business Value: CEO and CDO Insights into Rightmove’s AI Journey

Martin Stockdale on stage at Congress 2026

C-Suite Leading the Hybrid Workforce: Accountability, Decision-Making, and the Rise of AI-Native Organisations

DataIQ C-suite Panel Congress 2026

DataIQ Congress 2026: The End of AI Theatre

From AI Experimentation to Operating Discipline: What Leaders are Learning about Governance

From AI Experimentation to Operating Discipline: What Leaders are Learning about Governance

Beyond AI Experimentation: What Data Leaders are Learning About Scaling AI

Beyond AI Experimentation: What Data Leaders are Learning About Scaling AI

From Insight to Outcomes: Randy Bean opens DataIQ’s Boston Peer Exchange with a Challenge for Leaders

From Insight to Outcomes: Randy Bean opens DataIQ’s Boston Peer Exchange with a Challenge for Leaders

AI generated image of a tropical island set against a moody cloudy backdrop. An AI leader has anchored it to the ground

AI Leadership Today Is About Judgement, Not Just Speed

Quality at Scale: Discover Why Domino’s is DataIQ’s Highest-Scoring Award Winner This Decade

Quality at Scale: Discover Why Domino’s is DataIQ’s Highest-Scoring Award Winner This Decade

We just need 30 seconds of your time

Interested in:

By clicking “Continue” button, you are agreeing to the DataIQ terms of use and privacy statements.