Search this site
Embedded Files
Gerren Lamson
  • Home
  • About
  • Work
  • Writing
    • Articles
      • Driver Trees: Design Effective Alignment between Businesses and Customers
      • 4 Lessons from Leading a Vision Project for Indeed Hiring Platform
      • Assembling a Central System to Bridge Products
      • Redesigning Even Better File Organization (Part II)
      • 3 Things I Learned from Starting a Design Newsletter
      • Creating a Culture of Effective Design Feedback
      • Shaping Our Design Principles
      • Revamping Our Onboarding Process for Designers
      • How To Write Your Own UX Plan
      • Future-proofing UX in the Age of AI
    • UX Sourcebooks
      • UX Impact Data Claims
      • Broad User Research Insights
      • A11y & Inclusivity Checklist
      • Advanced Usability Checklist
      • UX Metrics 101
    • UX Field Guides
      • How to Decide If A Heuristic Evaluation Is the Right Method
Gerren Lamson
  • Home
  • About
  • Work
  • Writing
    • Articles
      • Driver Trees: Design Effective Alignment between Businesses and Customers
      • 4 Lessons from Leading a Vision Project for Indeed Hiring Platform
      • Assembling a Central System to Bridge Products
      • Redesigning Even Better File Organization (Part II)
      • 3 Things I Learned from Starting a Design Newsletter
      • Creating a Culture of Effective Design Feedback
      • Shaping Our Design Principles
      • Revamping Our Onboarding Process for Designers
      • How To Write Your Own UX Plan
      • Future-proofing UX in the Age of AI
    • UX Sourcebooks
      • UX Impact Data Claims
      • Broad User Research Insights
      • A11y & Inclusivity Checklist
      • Advanced Usability Checklist
      • UX Metrics 101
    • UX Field Guides
      • How to Decide If A Heuristic Evaluation Is the Right Method
  • More
    • Home
    • About
    • Work
    • Writing
      • Articles
        • Driver Trees: Design Effective Alignment between Businesses and Customers
        • 4 Lessons from Leading a Vision Project for Indeed Hiring Platform
        • Assembling a Central System to Bridge Products
        • Redesigning Even Better File Organization (Part II)
        • 3 Things I Learned from Starting a Design Newsletter
        • Creating a Culture of Effective Design Feedback
        • Shaping Our Design Principles
        • Revamping Our Onboarding Process for Designers
        • How To Write Your Own UX Plan
        • Future-proofing UX in the Age of AI
      • UX Sourcebooks
        • UX Impact Data Claims
        • Broad User Research Insights
        • A11y & Inclusivity Checklist
        • Advanced Usability Checklist
        • UX Metrics 101
      • UX Field Guides
        • How to Decide If A Heuristic Evaluation Is the Right Method

← All UX Field Guides

 UX_FIELD_GUIDE_1 

How to Decide If A Heuristic Evaluation Is the Right Method

TL;DR: Decide whether a heuristic evaluation is the right move right now, and if so, which variant fits your timeline and how much validation you need. Options range from a same-day AI-assisted internal pass to a two-week study with real customers.

Overview:

  • For: Practitioners and leaders choosing a research approach

  • Time to apply: 15 to 30 min to decide

  • Pulls from these UX Sourcebooks: Advanced Usability Checklist, Broad User Research Insights

Last updated: Sep 29, 2026

1. The situation

A flow is underperforming, or you're about to invest in fixing or redesigning something. You need a fast, credible read on usability problems before committing more time or money.

A heuristic evaluation is nearly always worth running. The real decision is which variant fits your situation, not whether to run one at all.

2. You're in this situation if...

  • A flow is underperforming and nobody understands or agrees on why.

  • You're about to commit design and/or engineering time to improve the workflow, and want a sanity check first.

  • You may have some product data (adoption, usage, retention, qual or quant sentiment), but no one has looked closely at the flow itself.

  • You want a shared, evidence-backed list of real issues before debating about what to fix, in which order, and how.

Product data tells you where to look, not what's wrong and why. Strong or weak usage and retention numbers are one primary reason to aim the evaluation at a specific flow, not a reason to skip running one.

3. Making the case (if you need buy-in first)

A quick way to answer the most common pushback before you propose a variant. Create a one page document with the intent, early signals on problems with the funnel, and a few bullets of Q&A with the following answers to things they might say:

  • Q: "We don't have time for research."

    • A: "This doesn't have to be a new research study. We can use an AI-assisted or human-led product trio evaluation that can be completed in as little as a day or two. Based on industry data, multiple evaluations typically catch 75 to 85% of usability problems in half a week."

  • Q: "We don't have the budget."

    • A: "The human-led internal product trio or proxy stakeholder variants use staff time we already have. There's nothing to recruit or pay for. We anticipate getting the clarity teams need to act on known and unknown issues in this part of the product experience."

  • Q: "We already know what's wrong."

    • A: "Then this effort will confirm it fast, uncover anything we've missed that's valuable, and turn scattered opinions into one prioritized, evidence-backed list everyone can act on."

  • Q: "Let's just ship and see."

    • A: "Fixing usability issues after launch costs more in rework, support volume, and churn than catching them before."

4. Decision: Which evaluation type fits your situation?

Different heuristic evaluation approaches

Conventional heuristic evaluations can be conducted a few different ways.  Here is a little more context about the options available to you:

  • AI-assisted internal evaluation. Same day. Fast pattern-matching. Misses context and real behavior. Treat findings as candidates to confirm, not conclusions. (Layer on internal team (product trio and/or cross-functional stakeholders) review for clarity).

  • Human-led internal product trio evaluation. 2-3 days. Experience product trio (PM, UX, eng) conducts evaluation, grounding judgment with real product workflow context. Lacking external customer perspective.

  • Human-led internal proxy function evaluation. 2-5 days. After short heuristics briefing, including sales, customer support, data analysts, and other internal subject-matter experts bolsters evaluations with proxy signal of real customer patterns without external recruiting. Their real value is in telling you how many customers they've personally seen encounter these issues, and scenarios in which they unfold.

  • Human-led external ICP research evaluation. 3-5+ days. Thoughtful recruiting of research participants and planning can lead to evidence-based findings from ideal customer profile users, not just internal opinion.

  • Combination: 5+ days. This most robust option requires careful collation of identified issues with attribution of which came from AI vs. internal vs. external review and effective storytelling.

The trade-off is always speed and internal confidence on one end, time and external validation on the other. Pick based on what the decision actually requires.

Deciding based on time available

Below is the primary 2x2 decision-making chart with the following axes: how much time you have, and whether you need real customer validation or if internal validation creates enough confidence to move forward.

Internal confidence will be enough to identify top issues.

  • AI-assisted internal evaluation. (Same day)

  • Human-led internal product trio evaluation (2-3 days)

  • Human-led internal proxy stakeholders evaluation (2-5 days)

Real customer validation is needed to clarify top issues.

  • AI-assisted internal evaluation w/ ideal customer profile data (research & behavioral data) (1-2 days; only a starting point)

  • Human-led external customer resaerch evaluation (3-5+ days)

Proxy functions or external customers?

If you are debating the need to use internal staff for an evaluation or engage with external customers, here is a way to decide:

Confirm which issues are real, and when and how often they occur.

  • Human-led internal product trio evaluation (2-3 days) Still enough for PM, UX, and Eng test drive their own product area (or a peer team's area) to hit key issues and which scenarios they occur in.

  • Human-led internal proxy stakeholders evaluation. (2-5 days) Support, sales, and analysts can tell you how many customers hit each issue, how often (qual or quant data) and which scenarios they occur in.

Understand why an issue happens if complexity and ambiguity make the path forward unclear.

  • Human-led internal proxy stakeholders evaluation. (2-5 days) Support, sales, and analysts can describe symptoms, not reasoning. Treat root-case questions as open until you can test directly with customers.

  • External ICP customers. (5+ days) Only real users can show you the actual decision-making and context behind critical issues.

Proxies are fast and free, but secondhand. Save external recruiting for the "why," not the "how many."A note on where AI fits here: an AI-assisted pass built on uploaded flows and screens can't answer either column in this table. It has no visibility into real occurrence or real reasoning. Getting AI into the "confirm which issues are real, and how often" column would take a different setup: an agent with direct access to real usage data (analytics, session recordings, support logs), not just static screens. That's a more advanced build than the package this guide assumes, so for now, treat proxy functions and external customers as the only sources for that column.

5. Watch-outs

  • Choosing speed when the decision needs validation. A same-day AI-assisted pass is a fine starting point, but don't let it be the final word on a high-stakes call. Schedule the validation step (whether internal product trio, internal proxy functions, or external customers) even if it comes later.

  • Skipping proxy or external input because it's inconvenient, when the decision actually needs an outside perspective to increase confidence and be more effective and scalable.

  • Treating existing usage data as a substitute. It tells you where to look. It doesn't replace looking.

  • Reporting AI-assisted findings as if they include frequency, confirmed occurrence, or divergent use cases. A pass built on uploaded flows and screens can only flag candidate issues, not how often they happen. Say "identified as a possible issue," not "occurring for X% of users," unless the finding actually came from proxy signal, external research, or an agent with real usage data behind it.

6. Next

  • A Field Guide on how to conduct a heuristic evaluation is coming soon. Once you've picked a variant here, this upcoming guide will cover setup, execution, scoring, and prioritization.

  • UX Sourcebooks leveraged in this Field Guide: Advanced Usability Checklist (full version and PDF).

← All UX Field Guides

If you enjoyed this resource, consider sharing it with a friend. 

Receive more resources and insights every month by signing up to receive my Unleash UX Newsletter on LinkedIn or through email.

© 2005-2026 Gerren Lamson · v2.1 · Last updated 9/28/26
Google Sites
Report abuse
Page details
Page updated
Google Sites
Report abuse