case study

UW Libraries - Scholarly Publishing & Open Scholarship Commons

organization

UW Libraries

ROLE

UX Researcher

EXPERTISE

UX Research

YEAR

2024

Project background

As a junior UX designer/researcher with the University of Washington Libraries, I worked with my team to lead and conduct a research study to streamline and enhance the Scholarly Publishing and Open Access (SPO) website.

As a junior UX designer/researcher with the University of Washington Libraries, I worked with my team to lead and conduct a research study to streamline and enhance the Scholarly Publishing and Open Access (SPO) website.

Timeline

Timeline

4 weeks

4 weeks

Background

Background

The University of Washington Libraries' Scholarly Publishing and Open Access (SPO) department supports the research endeavors of faculty and students by providing various services related to publishing and sharing research. Comments in the Ask Us portal indicated that users experienced navigational challenges and confusion related to the SPO website.

The University of Washington Libraries' Scholarly Publishing and Open Access (SPO) department supports the research endeavors of faculty and students by providing various services related to publishing and sharing research. Comments in the Ask Us portal indicated that users experienced navigational challenges and confusion related to the SPO website.

Purpose

Purpose

The goal of this study was to assess the information architecture of the SPO website and ensure it aligned with user needs, checking if users can easily locate the information they require.

Evaluate Information Architecture

Evaluate Information Architecture

Assess the current structure of the website and determine how effectively it supports user navigation and information discovery.

Assess the current structure of the website and determine how effectively it supports user navigation and information discovery.

Understand User Needs and Behaviors

Understand User Needs and Behaviors

Gain insights into the specific needs, preferences, and behaviors of the primary user groups, including faculty, students, and researchers.

Gain insights into the specific needs, preferences, and behaviors of the primary user groups, including faculty, students, and researchers.

Identify Vocabulary and Language Clarity

Identify Vocabulary and Language Clarity

Ensure the terminology used on the website is accessible and understandable across diverse academic disciplines.

Ensure the terminology used on the website is accessible and understandable across diverse academic disciplines.

Research Questions

Research Questions

  1. How do users navigate the current SPO website, and where do they encounter difficulties?

  1. What terminology related to research data services and scholarly communications is most familiar and understandable to our target audience (faculty, staff, and graduate students)?

  1. How do we best combine data from this research and user feedback from the Ask Us portal to inform the redesign?

Participants

Participants

We set up tables at key campus locations frequented by our target users, such as the Health Science Library, Li Lu Library, and the Open Scholarship Commons and recruited relevant users to participate in a short research session.

We set up tables at key campus locations frequented by our target users, such as the Health Science Library, Li Lu Library, and the Open Scholarship Commons and recruited relevant users to participate in a short research session.

Methodology

Methodology

The UX Cafe, a guerrilla research method regularly used by the Information Technology Services & Digital Strategies department, was employed to gather quick feedback from users. This approach eliminated the need for extensive scheduling and planning, allowing for efficient data collection, and proven to be more successful with the target audience for this research.

The UX Cafe, a guerrilla research method regularly used by the Information Technology Services & Digital Strategies department, was employed to gather quick feedback from users. This approach eliminated the need for extensive scheduling and planning, allowing for efficient data collection, and proven to be more successful with the target audience for this research.

Table Setup

Table Setup

The UX Cafe was conducted in three locations: the Health Science Library, the Li Lu Library, and the Open Scholarship Commons.

The UX Cafe was conducted in three locations: the Health Science Library, the Li Lu Library, and the Open Scholarship Commons.

User Interviews

User Interviews

Participants were engaged in brief interviews to understand their background, research activities, and interactions with UW library resources.

Participants were engaged in brief interviews to understand their background, research activities, and interactions with UW library resources.

Tree Testing

Tree Testing

Using Optimal Workshop, users were tasked with navigating a text-based menu to locate information related to thesis publishing, data visualization, and data archiving in the Research Works, Scholarly Publishing, and Digital Scholarship sites.

Using Optimal Workshop, users were tasked with navigating a text-based menu to locate information related to thesis publishing, data visualization, and data archiving in the Research Works, Scholarly Publishing, and Digital Scholarship sites.

Feedback Collection

Feedback Collection

Follow-up questions were asked to identify areas of confusion, vocabulary challenges, and overall user experience.

Follow-up questions were asked to identify areas of confusion, vocabulary challenges, and overall user experience.

Sample Questions & Tasks

Sample Questions & Tasks

We began by asking participants about their background and needs along with the resources and tools they commonly use in their work or research. Next, we guided them through task-related questions for the tree testing, focusing on how they would navigate the site to find specific information. Finally, we asked follow-up questions to delve into their thought process, uncover any points of confusion, and identify areas where the navigation or terminology was unclear.

Sample Questions

Background

Background

What UW library resources or support have you used? What do you usually use them for and how?

Task-specific

Task-specific

You're finishing your thesis and want guidance on how to publish it. Where would you expect to find this information?

Follow-up

Are there any points of confusion? Can you elaborate?

Analysis and Synthesis

Analysis and Synthesis

Post-session debriefs allowed us to immediately capture key insights. We conducted thorough synthesis sessions where we triangulated data obtained through the qualitative and quantitative methods and uncovered deeper patterns across participants.

Quantitative data

Quantitative data

Leveraged metrics from Optimal Workshop (e.g., success rate, directness, and time taken) to measure task efficiency.

Qualitative data

Qualitative data

Analyzed participant feedback to identify common challenges in navigation, vocabulary confusion, and task completion.

Affinity mapping

Affinity mapping

Grouped similar responses to identify key user pain points.

Sensemaking

Sensemaking

Reviewed data from various sources to understand user mental models and prioritize issues for iteration.

Key Takeaways

Participants encountered several usability challenges on the site, including unclear terminology and complex navigation paths. These issues led to difficulties in task completion and heightened user frustration.

Vocabulary confusion

Vocabulary confusion

Participants found several terms on the website confusing. Many had never encountered these terms or were unclear about their meanings.

Navigational Issues

Navigational Issues

Participants struggled with the site’s structure and navigation. Categories with similar headers caused confusion about where relevant content would be found.

Complexity of Information Architecture

Complexity of Information Architecture

Many participants assumed they could find essential information directly from the homepage but were overwhelmed by the number of steps they had to take to find the information.

Outputs & Deliverables

Outputs & Deliverables

Report

A comprehensive document detailing our purpose, methodology, findings, and recommendations which was shared with the department.

A comprehensive document detailing our purpose, methodology, findings, and recommendations which was shared with the department.

A comprehensive document detailing our purpose, methodology, findings, and recommendations which was shared with the department.

Presentation

A comprehensive slide deck detailing the entire study process which was presented in a department-wide meeting.

A comprehensive slide deck detailing the entire study process which was presented in a department-wide meeting.

A comprehensive slide deck detailing the entire study process which was presented in a department-wide meeting.

Testing Results

Visual representations of user pathways and testing results that highlight participant interactions with the site.

Visual representations of user pathways and testing results that highlight participant interactions with the site.

Visual representations of user pathways and testing results that highlight participant interactions with the site.

Impact

Impact

This research has provided us with a deeper understanding of our target users, enabling us to tailor the site more effectively to meet their needs.

Prioritized improvements

Prioritized improvements

Specific usability issues identified during the study were prioritized for immediate action, leading to improved user experience.

Informed site redesign

Informed site redesign

The findings directly influenced our upcoming site redesign, guiding decisions on layout, terminology, and navigational structure to enhance usability and increase site engagement.

Enhanced understanding of user needs

Enhanced understanding of user needs

We gained valuable insights into our target users' behaviors and preferences, allowing us to tailor content and navigation to better meet their needs.

Next Steps & Recommendations

Next Steps & Recommendations

Following the research, our next steps focus on implementing the insights into the upcoming site redesign.

Streamlined navigation

Streamlined navigation

Streamline the information architecture by clarifying categories and pathways, making it easier for users to find relevant content.

Clearer categorization

Clearer categorization

Revise labels and descriptions to align more closely with user terminologies and workflows.

Distinct categories

Distinct categories

Create unique category names that clearly differentiate content and eliminate overlap, particularly between "scholarly publishing" and "digital scholarship."

Targeted user testing

Targeted user testing

Continue collecting user feedback through targeted testing sessions with key user groups to gain deeper insights into their mental models, needs, and pain points.

Diverse recruitment

Diverse recruitment

Expand participant recruitment to include graduate students from a broader range of fields, ensuring a more comprehensive understanding of diverse user needs and perspectives.

The next steps include integrating the research insights into the website redesign and conducting targeted user testing to validate the improvements. Follow-up actions will focus on testing the revised visual elements and information architecture to ensure alignment with user expectations.

Reflections

Reflections

Though the project successfully yielded valuable insights into student research behaviors and their interactions with the libraries' tools and services, we would have liked to reach a broader audience of users including staff and faculty. Conducting larger, more in-depth interviews with a diverse user group would enhance our findings. Although funding and resources are currently limited, securing the means to incentivize participants for more extensive studies could significantly improve our understanding and uncover key insights that may have been overlooked.