Expert analysis is a usability evaluation method where experts review a system (or design artifacts like prototypes or specifications) to identify potential usability problems without involving real users.
Causes
Need for fast, low-cost evaluation early in the design process.
Lack of access to users or usability labs.
Goals / Objectives
Identify areas likely to cause user difficulties.
Assess whether a system adheres to accepted usability principles.
Importance
Can be applied at any stage of development—from design specs to fully implemented systems.
Provides early feedback without requiring user recruitment or lab setup.
Benefits
Fast and inexpensive compared to user testing.
Does not require a well-equipped lab or user participation.
Useful for catching major usability issues before user testing.
Does not assess actual user behavior or real-world use
Limited to expert judgment rather than empirical user data
Impact / Effect
Helps improve usability before costly development or user testing phases.
May miss issues that only emerge during real user interaction.
Examples
Reviewing a wireframe using Nielsen’s heuristics.
Evaluating a prototype with a cognitive walkthrough.
Cognitive Walkthrough
Definition
A usability evaluation method where one or more evaluators simulate a first-time user performing tasks to assess how easy the system is to learn.
Causes
Need to evaluate learnability of “walk-up-and-use” systems (e.g., ATMs, kiosks).
Goals / Objectives
Determine how easy a system is for new users to learn.
Identify usability problems that affect first-time use.
Discover desirable new features or missing functionality.
Importance
Focuses specifically on learnability, a core aspect of usability.
Can be used early in design with prototypes or storyboards.
Benefits
Finds severe usability problems related to task completion by novices.
Can be combined with “think aloud” for richer insights.
Enables evaluation using imagined user behavior (e.g., personas).
Procedures
Prepare:
A prototype or design representation
A description of target users (knowledge, experience)
A set of representative tasks
For each task, evaluators ask four key questions:
Will the user try to achieve the right outcome? (Goal match)
Will the user notice that the correct action is available? (Visibility)
Will the user recognize that the action will achieve their goal? (Matching action to outcome)
Will the user understand the feedback after performing the action? (Feedback clarity)
Experts may use “think aloud” to verbalize reasoning during the walkthrough.
Advantages & Disadvantages
Advantages:
Focused on first-time user experience
Structured, question-based approach
Works with low-fidelity artifacts
Disadvantages:
Does not involve real users
Relies on evaluator’s ability to simulate user thinking accurately
Impact / Effect
Highlights design flaws that hinder initial learning.
Informs improvements in visibility, labeling, feedback, and task flow.
Examples
Evaluating an ATM interface for first-time users.
Testing a museum kiosk by simulating a visitor’s task (e.g., “Find today’s events”).
Using a persona to imagine how a student would log in to check exam results for the first time.
Heuristic Evaluation
Definition
A usability inspection method where a small group of evaluators independently assess a system against a set of recognized usability principles (heuristics).
Causes
Need for a structured, principle-based review of interface designs.
Desire to catch common usability problems early and efficiently.
Goals / Objectives
Identify potential usability problems by checking compliance with established heuristics.
Provide actionable feedback for design improvement.
Importance
One of the most widely used expert review methods in HCI.
Effective for early-stage evaluation and applicable to any design artifact.
Benefits
Can be used on design specs, storyboards, prototypes, or finished systems.
Multiple evaluators increase problem detection coverage.