Chapter 4: Users Cognitive Capabilities

Introduction to Cognitive Capabilities in HCI

Definition

  • The study of how users interpret, process, and act on information during interaction with technology.

Causes

  • Interaction with technology inherently involves cognitive processing; design must account for mental limitations.

Goals / Objectives

  • Provide knowledge about what users can and cannot be expected to do cognitively.
  • Identify and explain the nature and causes of user problems.
  • Apply cognitive theories and models to design better interactive products.

Importance

  • Cognition underpins all user interactions; ignoring cognitive limits leads to inefficient, frustrating, or error-prone systems.

Procedures

  • Analyze core cognitive aspects: attention, perception/recognition, memory, language, problem-solving, and learning.
  • Apply design principles based on cognitive science findings.

Benefits

  • Leads to interfaces that align with how users naturally think and process information.

Advantages & Disadvantages

  • Advantages:
    • Reduces user errors and cognitive load
  • Disadvantages:
    • Not specified in notes

Impact / Effect

  • Poor cognitive fit causes inefficiency, anxiety, and stress; good fit enhances usability and satisfaction.

Examples

  • Not specified in notes (general principle introduced)

Attention

Definition

  • The cognitive ability to focus on information relevant to the current task, typically involving visual or auditory senses.

Causes

  • Limited cognitive capacity requires selective focus on relevant stimuli while filtering out distractions.

Goals / Objectives

  • Structure interface information to guide and maintain user focus effectively.

Importance

  • Critical for task completion; poor attention management leads to missed information or errors.

Procedures

  • Use perceptual boundaries (e.g., windows), color, reverse video, sound, and flashing lights to highlight important elements.
  • Arrange information logically and avoid clutter (e.g., Google.com homepage).
  • Apply visual grouping through ordering, spacing, underlining, sequencing, and animation.

Benefits

  • Helps users locate and process critical information quickly.

Advantages & Disadvantages

  • Advantages:
    • Visual cues speed up search and decision-making
  • Disadvantages:
    • Overuse of attention-grabbing techniques (e.g., flashing) can cause distraction

Impact / Effect

  • Well-structured layouts reduce search time (e.g., Tullis, 1987: 3.2s vs. 5.5s for hotel price search).

Examples

  • Tullis (1987) study: better-aligned screen layout reduced search time from 5.5s to 3.2s
  • Google.com as a model of uncluttered design
  • DuckDuckGo interface (linked as reference)

Perception and Recognition

Definition

  • The process of becoming aware of external stimuli through the senses and interpreting their meaning.

Causes

  • Users rely on sensory input to understand interface elements; poor design impedes accurate interpretation.

Goals / Objectives

  • Design representations that are readily perceivable and recognizable.

Importance

  • Ensures users can quickly and accurately interpret icons, text, and layout.

Procedures

  • Make text clear and legible with sufficient contrast between foreground and background.
  • Use consistent fonts to avoid visual clutter.
  • Apply Gestalt principles of perception:
    • Proximity: group related items close together
    • Continuity: align elements along smooth paths
    • Similarity: use same color/shape for related items
    • Figure-ground: distinguish foreground from background clearly
  • Use borders and spacing to group information visually.

Benefits

  • Improves speed and accuracy of interface interpretation.

Advantages & Disadvantages

  • Advantages:
    • Gestalt principles support intuitive grouping and scanning
  • Disadvantages:
    • Low contrast or inconsistent fonts reduce readability

Impact / Effect

  • Poor perception design leads to confusion, slower task performance, or misinterpretation.

Examples

  • Share icons designed for quick recognition
  • Comparison of text readability based on contrast levels
  • Visual grouping via spacing and borders (as mentioned in notes)

Memory

Definition

  • The cognitive system for encoding, storing, and retrieving information, consisting of sensory, short-term, and long-term memory.

Causes

  • Human memory has structural limitations that affect interaction design.

Goals / Objectives

  • Minimize demands on user memory to reduce errors and stress.

Importance

  • Overloading memory causes inefficiency, anxiety, and task failure.

Procedures

  • Sensory memory (SM): brief retention of sensory input (eyes, ears, touch).
  • Short-term/working memory (STM/WM):
    • Holds ~7±2 “chunks” of information (Miller, 1956)
    • Information decays rapidly
    • Accessed quickly but capacity is limited
  • Long-term memory (LTM):
    • Infinite capacity
    • Retrieval takes time
    • Accessibility decreases over time without use
  • Favor recognition over recall (e.g., GUI menus vs. CLI commands).
  • Use chunking to group information into meaningful units for easier memorization.

Benefits

  • Reduces cognitive burden and supports faster, more accurate interaction.

Advantages & Disadvantages

  • Advantages:
    • Recognition-based interfaces (e.g., web browser history) are easier to use
    • Chunking improves memorability
  • Disadvantages:
    • Recall-heavy systems (e.g., command-line) slow users down

Impact / Effect

  • Systems requiring LTM recall feel slower and more error-prone.

Examples

  • Lists of numbers or words used to illustrate STM limits (e.g., “9, 1, 5, 2, 3…”)
  • Web browsers showing visited URLs to support recognition
  • GUIs vs. CLIs: GUIs leverage recognition, CLIs require recall

Recognition vs. Recall

Definition

  • Recognition: identifying information from presented options.
  • Recall: retrieving information from memory without cues.

Causes

  • Human memory is better at recognizing than recalling due to contextual cues.

Goals / Objectives

  • Design interfaces that minimize recall and maximize recognition.

Importance

  • Recognition reduces cognitive load and improves usability.

Procedures

  • Provide visible options (menus, icons, history lists) instead of requiring users to remember commands.
  • Support memory encoding through categories, color coding, flagging, and time stamping.

Benefits

  • Faster task completion and fewer errors.

Advantages & Disadvantages

  • Advantages:
    • Users perform better with visual cues
  • Disadvantages:
    • Recall-based systems increase mental effort

Impact / Effect

  • GUIs outperform CLIs in learnability and efficiency due to recognition support.

Examples

  • Command-line interfaces require recall of command names (e.g., “cp”)
  • GUI file explorers show icons and names for recognition
  • Browser history lists enable recognition of previously visited sites

Chunking

Definition

  • A memory strategy that groups individual pieces of information into larger, meaningful units (“chunks”).

Causes

  • STM capacity is limited (~7±2 items); chunking expands effective memory span.

Goals / Objectives

  • Improve memorability of information that must be retained temporarily.

Importance

  • Enables users to handle more complex tasks without exceeding cognitive limits.

Procedures

  • Group related data (e.g., phone numbers as “area code–number”).
  • Organize interface elements into logical sections.
  • Apply George Miller’s (1956) principle: “More can be remembered if items are chunked.”

Benefits

  • Enhances short-term retention and task performance.

Advantages & Disadvantages

  • Advantages:
    • Makes memorization feasible for multi-step tasks
  • Disadvantages:
    • Not effective if chunks lack meaning or logic

Impact / Effect

  • Poor chunking leads to information overload; good chunking supports workflow.

Examples

  • Phone number format: “area code–phone no” (as mentioned in notes)
  • Grouping settings into categories in a preferences menu

Mental Models

Definition

  • Internal representations users form about how a system works, based on experience and inference.

Causes

  • Users build mental models to predict system behavior and guide actions, especially with unfamiliar systems.

Goals / Objectives

  • Design systems that match users’ existing mental models or help them build accurate ones.

Importance

  • Mismatches between user and system models cause confusion and errors.

Procedures

  • Allow users to make predictions about system behavior (e.g., “How does an ATM work?”).
  • Support learning through consistent, intuitive design.
  • Use metaphors to transfer familiar concepts (e.g., “files” and “folders”).
  • Improve user mental models through feedback and onboarding.

Benefits

  • Increases user confidence, efficiency, and error recovery.

Advantages & Disadvantages

  • Advantages:
    • Metaphors aid initial understanding
  • Disadvantages:
    • Metaphors don’t scale well with complexity
    • Can be misleading across cultures or with overextension
    • Mental models are hard to capture and validate (as noted in Rogers et al., 1992)

Impact / Effect

  • Accurate mental models lead to smoother interaction; inaccurate ones cause frustration.

Examples

  • Mental model of car ignition, ATM operation, or computer boot process
  • File/folder metaphor in operating systems
  • Metaphor breakdown: file icons become clumsy as systems scale

Cultural Considerations in Cognitive Design

Definition

  • The influence of cultural background on interpretation of symbols, colors, and interface conventions.

Causes

  • Mental models and associations are shaped by cultural context.

Goals / Objectives

  • Avoid culturally biased assumptions in interface design.

Importance

  • Ensures global usability and prevents misinterpretation.

Procedures

  • Recognize that common associations vary by region:
    • Color: red = danger (West) vs. prosperity (China); stock markets: red = up (China), green = up (US)
    • White: funeral (China) vs. wedding (US)
    • Light switches: down = off (US), down = on (UK)

Benefits

  • Supports inclusive, internationally usable designs.

Advantages & Disadvantages

  • Advantages:
    • Reduces cultural friction in global products
  • Disadvantages:
    • Requires deeper user research across regions

Impact / Effect

  • Culturally mismatched designs confuse or alienate users.

Examples

  • Red/green color meanings in stock markets (China vs. US)
  • White color symbolism: funeral (China) vs. wedding (US)
  • Light switch directions: US (down = off) vs. UK (down = on)