Summary
Mastercard is in the middle of a shift in how decisions are made throughout the product development lifecycle, with data-informed design at the center. A suite of measurements have been developed to quantify the quality of products and the resulting experiences at points across the product lifecycle, so teams can have customer-centric conversations about opportunities and risks. Hear more about these CX Metrics and how we’ve infused them into the product development lifecycle to exert influence across dozens of products across the company.
Key Insights
-
•
MasterCard's CX metrics are being shared publicly for the first time to drive transparency and accountability in product decisions.
-
•
Data should speak both the language of business and align with the values of design to improve product offerings.
-
•
Measuring customer implementation and user engagement is more indicative of success than merely launching products.
-
•
Shifting from a sales-led to a customer-led approach can sometimes lead to over-customization and bloated products.
-
•
Concept Desirability Score helps evaluate multiple product ideas early in the development process, identifying best opportunities and risks.
-
•
Design Quality Score focuses on the usability and emotional experience of a single, targeted product idea during prototype stages.
-
•
Ownership of product quality metrics fosters accountability among product teams, encouraging actionable insights.
-
•
Cross-functional collaboration is essential for successful product implementation and user experience.
-
•
Product onboarding standards improve time to revenue by ensuring customers have what they need to succeed with new products.
-
•
Collecting quantitative and qualitative data ensures decisions are informed and reduce the risk of 'vibe-based' decision-making.
Notable Quotes
"We've found a way to use data to speak the language of business."
"We only make money when our products get used."
"Historically, we've been very sales led, but we need to refocus on meaningful indicators of product success."
"The concept desirability score helps us determine what to design based on unmet needs."
"There's only 300 designers spread across MasterCard, and there's 10 times that in terms of product managers."
"Product success needs to be about more than new features and go to market; it’s about helping customers be more successful."
"We’re manufacturing data that highlights the values we've agreed are important to the company."
"This is not the time that you should be building the plane while you’re flying it."
"The scores are a means to an end, aiming to encourage behavior change."
"It’s about the learning and the iteration."
More Videos
"The more we grow, the more we get tapped on the shoulder for narratives around agent behavior."
Sean Fitzell Sarah Han Kayla FarrellCraft of User Research: Building Out Jobs to be Done Maps
March 12, 2021
"Starting with an edge case can lead to mainstream innovation."
Billy CarlsonIdeation tips for Product Managers
December 6, 2022
"The heart of our discovery was getting to know our team and their vision for design maturity."
Francesca Barrientos, PhDYou Need Your Own Definition of Design Maturity
June 8, 2022
"What do you want your AI to do? What do you want their background to be?"
Noz UrbinaRapid AI-powered UX (RAUX): A framework for empowering human designers
May 1, 2025
"Today’s digital experience is imperfect in the eyes of many consumers."
Andrew Custage Michael MallettThe Digital Journey: Research on Consumer Frustration and Loyalty
March 29, 2023
"We realized we had to completely change our approach to the digital presence and focus on user-centered design principles."
Mackenzie Cockram Sara Branco Cunha Ian FranklinIntegrating Qualitative and Quantitative Research from Discovery to Live
December 16, 2022
"Women are more likely to shoulder burdens that are often invisibilized in our research and design processes."
Mansi GuptaWomen-Centric Research: What, Why, How
March 29, 2023
"Not every story will be positive, so we focus on the inspiring ones for motivation."
Ross SmithBreaking Barriers with Empathy
June 9, 2017
"The ability to plan ahead falls apart under VUCA conditions."
Jorge ArangoDesign as an Antidote to VUCA
May 9, 2019
