Search Results

By Philip Burgess | UX Research Leader Understanding how users navigate complex information is a challenge for many designers and researchers. One effective method to evaluate this is the Tree Test . This technique helps uncover how easily people find information within a website or app’s structure. If you want to improve your site’s navigation or organize content more clearly, a Tree Test offers valuable insights. Diagram showing a website's navigation tree structure What Is a Tree Test? A Tree Test is a usability method that evaluates the hierarchy and labeling of a website or app’s content. Unlike traditional usability tests that focus on the interface design, Tree Tests isolate the structure by removing visual elements like colors, images, or buttons. Participants see only a text-based outline of the site’s categories and subcategories. The goal is to find out if users can locate specific items or information by navigating this simplified tree. For example, if you ask someone to find “return policy,” the test shows whether they can pick the right category and subcategory without confusion. Why Use a Tree Test? Many websites grow over time, adding pages and sections without clear organization. This can frustrate users who struggle to find what they need. A Tree Test helps by: Identifying confusing or unclear category names Revealing where users get lost or give up Showing if important content is buried too deep Helping prioritize restructuring efforts By testing the navigation structure early, you save time and money on redesigns. It also improves user satisfaction and reduces bounce rates. How to Conduct a Tree Test Running a Tree Test involves a few key steps: Create the Tree Extract the site’s navigation structure, including main categories and subcategories. Present this as a simple text list or outline. Define Tasks Write clear tasks for participants, such as “Find where you would look for shipping information.” Tasks should reflect real user goals. Recruit Participants Choose people who represent your typical users. Even 15-20 participants can provide useful data. Run the Test Participants navigate the tree to complete each task. They select categories step-by-step until they find the best match. Analyze Results Look for patterns in where users succeed or fail. Pay attention to common wrong choices or hesitation points. Examples of Tree Test Insights Imagine an online bookstore with categories like “Fiction,” “Non-Fiction,” “Children’s Books,” and “Special Offers.” A Tree Test might reveal: Users expect “Bestsellers” under “Special Offers,” but it’s actually under “Fiction.” This mismatch causes confusion. “Children’s Books” is buried under “Non-Fiction,” making it hard to find. The label “Special Offers” is vague; users don’t realize it includes discounted books. These insights guide renaming categories, moving sections, or adding clearer labels. Participant interacting with a tree test interface on a laptop Best Practices for Tree Testing To get the most from your Tree Test, keep these tips in mind: Use real user language for category names. Avoid jargon or internal terms. Keep the tree simple and consistent . Too many levels or inconsistent naming confuses users. Test one version at a time . If you want to compare structures, run separate tests. Include open-ended feedback to understand why users made certain choices. Combine Tree Testing with other usability methods for a full picture. When to Use a Tree Test Tree Tests work best in these situations: Before designing or redesigning a website’s navigation When adding new content categories or sections To validate assumptions about how users group information After noticing users struggle to find content in analytics or support queries They are less useful for testing visual design, interaction, or content quality. Tools for Tree Testing Several online tools make running Tree Tests easier. Some popular options include: Optimal Workshop’s Treejack : Offers task creation, participant recruitment, and detailed reports. UsabilityHub : Provides simple tree testing with quick turnaround. UserZoom : Combines tree testing with other UX research methods. Many tools allow remote testing, which broadens your participant pool and speeds up results. Improving Your Site with Tree Test Results Once you gather data, use it to: Rename confusing categories to match user expectations Rearrange sections to reduce clicks and improve findability Remove redundant or overlapping categories Add helpful labels or descriptions where needed Iterate on your structure and retest to confirm improvements. Over time, this leads to a clearer, user-friendly navigation system.

By Philip Burgess | UX Research Leader Cultural probes offer a unique way to explore people's lives, thoughts, and environments. They provide rich, personal insights that traditional research methods often miss. This post explains what cultural probes are, how they work, and why they matter for designers, researchers, and anyone interested in understanding human behavior. A notebook with handwritten notes and sketches from a cultural probe activity What Are Cultural Probes? Cultural probes are sets of tasks or tools given to participants to capture their daily experiences, feelings, and environments. Instead of direct interviews or surveys, probes encourage people to document their lives creatively and spontaneously. This method helps researchers gather subjective and emotional data that reveal deeper insights. The concept originated in design research during the 1990s, aiming to understand users in their natural context. Probes often include items like cameras, diaries, maps, or postcards with open-ended questions. Participants use these tools over days or weeks, providing a window into their world. How Cultural Probes Work The process starts by designing a probe kit tailored to the research goal. For example, if a team wants to understand how people use public parks, the kit might include a disposable camera, a map to mark favorite spots, and a journal with prompts about park experiences. Participants receive the kit and complete the tasks at their own pace. They might take photos of meaningful places, write about daily routines, or draw maps of their neighborhoods. The key is to let participants express themselves freely without strict instructions. After collecting the completed probes, researchers analyze the materials for patterns, emotions, and unexpected details. This qualitative data helps build empathy and informs design decisions or policy-making. Benefits of Using Cultural Probes Cultural probes offer several advantages over traditional research methods: Rich, personal data : Probes capture feelings and context that surveys often miss. Participant empowerment : People control what and how they share, leading to authentic insights. Flexibility : Probes can be adapted for different cultures, age groups, or topics. Creativity : The open-ended nature encourages unique responses and storytelling. These benefits make cultural probes especially useful in early-stage design or exploratory research when understanding user needs is critical. Examples of Cultural Probes in Action Several projects have successfully used cultural probes to gather meaningful data: A team designing a new kitchen appliance gave participants cameras and diaries to document cooking habits. The insights revealed overlooked frustrations and inspired user-friendly features. Researchers studying urban mobility asked people to map their daily routes and take photos of obstacles. This helped city planners identify problem areas and improve infrastructure. In healthcare, cultural probes helped patients express their experiences with chronic illness, guiding the development of supportive tools and services. These examples show how probes uncover details that traditional methods might overlook. Disposable camera and hand-drawn map from a cultural probe kit Tips for Creating Effective Cultural Probes To get the most from cultural probes, consider these tips: Keep tasks simple and engaging : Avoid overwhelming participants with too many or complex activities. Use diverse tools : Combine writing, drawing, and photography to capture different perspectives. Be clear about purpose : Explain why the probe matters to motivate participants. Respect privacy : Allow people to skip questions or tasks they find uncomfortable. Plan for analysis : Have a strategy to organize and interpret the collected materials. By following these guidelines, researchers can design probes that yield valuable and actionable insights. When to Use Cultural Probes Cultural probes work best when you want to: Explore new or sensitive topics where direct questions might limit responses. Understand the context of use for products or services. Gain emotional and subjective insights. Engage participants in a creative and reflective way. They are less suited for collecting large-scale quantitative data or when precise measurements are needed.

By Philip Burgess | UX Research Leader Eye-tracking technology reveals where and how people look at visual information. This insight helps understand attention, perception, and decision-making in ways that words alone cannot explain. Whether used in research, design, or healthcare, eye-tracking offers a window into human behavior by capturing eye movements with precision. Eye-tracking device capturing eye movements How Eye-Tracking Works Eye-tracking systems use cameras and infrared light to detect eye positions and movements. The technology measures where the gaze lands, how long it stays, and the sequence of eye movements. These measurements include: Fixations : Moments when the eye stops moving and focuses on a specific point. Saccades : Rapid eye movements between fixations. Pupil dilation : Changes in pupil size that can indicate cognitive load or emotional responses. By analyzing these elements, eye-tracking provides detailed maps of visual attention. Applications of Eye-Tracking Eye-tracking finds use in many fields. Here are some practical examples: User Experience and Design Designers use eye-tracking to understand how users interact with websites, apps, or products. For example, a study might reveal that users overlook a call-to-action button because their gaze is drawn elsewhere. This insight helps improve layouts and navigation. Psychology and Neuroscience Researchers study eye movements to explore cognitive processes such as reading, memory, and attention. Eye-tracking can detect subtle differences in how people with conditions like autism or ADHD process visual information. Healthcare and Rehabilitation Eye-tracking assists in diagnosing neurological disorders and monitoring recovery. For instance, it helps assess visual impairments after a stroke or track progress in patients with Parkinson’s disease. Marketing and Consumer Behavior Marketers analyze eye-tracking data to see which parts of an advertisement attract attention. This information guides the placement of key messages and visuals to increase engagement. Person using wearable eye-tracking glasses in a usability study Benefits of Eye-Tracking Eye-tracking offers several advantages: Objective data : It captures real-time, unbiased information about visual attention. Non-invasive : Most eye-tracking methods do not interfere with natural behavior. Detailed insights : It reveals patterns that are difficult to detect through surveys or interviews. Versatile : Applicable across many disciplines and environments. Challenges and Limitations Despite its strengths, eye-tracking has some limitations: Cost and complexity : High-quality systems can be expensive and require technical expertise. Calibration needs : Accurate tracking depends on proper calibration for each user. Data interpretation : Raw eye-tracking data requires careful analysis to avoid misleading conclusions. Environmental factors : Lighting and head movements can affect accuracy. Future Directions Eye-tracking technology continues to evolve. Emerging trends include: Integration with virtual and augmented reality to create immersive experiences that respond to gaze. Improved wearable devices that allow natural movement during tracking. AI-driven analysis to automate interpretation and uncover deeper patterns. Expanded use in education to tailor learning materials based on student attention. Eye-tracking is becoming more accessible and powerful, opening new possibilities for understanding human behavior.

By Philip Burgess | UX Research Leader Imagine testing a new product or feature without building the full technology behind it. This is exactly what Wizard-of-Oz testing allows teams to do. It offers a way to explore user reactions and gather feedback early in the design process by simulating functionality with human intervention behind the scenes. Wizard-of-Oz testing is a valuable method for product designers, developers, and user experience researchers who want to validate ideas before investing heavily in development. This post explains what Wizard-of-Oz testing is, how it works, and why it can be a powerful tool for creating better products. Wizard-of-Oz testing setup with a prototype device and human operator What is Wizard-of-Oz Testing? Wizard-of-Oz testing is a usability testing technique where users interact with a system that appears fully functional but is actually operated or partially operated by a human behind the scenes. The user believes they are using an automated system, but the "wizard" controls some or all of the system’s responses. This approach helps teams test concepts that are difficult or expensive to build fully at an early stage. For example, if a team is designing a voice assistant, they might have a person listen to user commands and respond manually instead of programming the assistant’s AI. This allows the team to observe real user behavior and gather insights without waiting for complex technology to be ready. How Wizard-of-Oz Testing Works The process typically involves these steps: Design the prototype : Create a user interface or product mockup that looks like the final version. Set up the wizard : Assign a person or team to control the system’s responses behind the scenes. Conduct user sessions : Have users interact with the prototype, unaware that a human is controlling some functions. Collect feedback : Observe user behavior, record sessions, and gather qualitative and quantitative data. Analyze results : Identify pain points, preferences, and opportunities for improvement. This method works well for testing new interaction models, such as conversational interfaces, recommendation systems, or complex workflows that require human judgment. Benefits of Wizard-of-Oz Testing Wizard-of-Oz testing offers several advantages: Early validation : Test ideas before investing in full development. Cost-effective : Avoid building expensive backend systems too soon. Realistic user feedback : Capture natural user reactions to near-real experiences. Flexibility : Quickly adjust responses or scenarios based on user input. Risk reduction : Identify design flaws and usability issues early. For example, a startup developing a smart home assistant used Wizard-of-Oz testing to simulate voice commands and responses. This helped them understand which features users found most valuable and how they expected the assistant to behave, guiding the product roadmap. When to Use Wizard-of-Oz Testing This testing method fits best when: The technology is not yet ready or too costly to build. You want to explore user interaction with new or complex features. You need to test multiple design options quickly. You want to observe natural user behavior without revealing prototype limitations. Avoid using Wizard-of-Oz testing for products that require fully automated, real-time responses where human intervention would distort the experience, such as high-frequency trading platforms or safety-critical systems. Tips for Effective Wizard-of-Oz Testing To get the most from this approach, consider these tips: Keep the wizard hidden : Ensure users do not realize a human controls the system. Train the wizard : The operator should respond quickly and consistently. Define clear scenarios : Prepare scripts or guidelines for common user interactions. Record sessions : Use video or screen capture to review user behavior later. Iterate rapidly : Use findings to refine the prototype and test again. Real-World Example A team designing an AI-powered customer support chatbot used Wizard-of-Oz testing to simulate the chatbot’s responses. A human operator typed replies based on user questions while the team observed how users phrased their requests and what answers satisfied them. This helped the team build a more natural and helpful chatbot once the AI was developed. Chat interface prototype used in Wizard-of-Oz testing with human operator responses Moving Forward with Wizard-of-Oz Testing Wizard-of-Oz testing is a practical way to explore user needs and test ideas without full technical implementation. It helps teams build better products by focusing on user experience early and avoiding costly mistakes. If you are developing a new product or feature, consider using Wizard-of-Oz testing to gather real user feedback and validate your assumptions. This approach can save time, reduce costs, and improve your chances of success.

By Philip Burgess | UX Research Leader Understanding how users interact with a product is essential for creating intuitive and effective designs. Moderated usability testing offers a direct way to observe users, gather feedback, and uncover issues that might otherwise remain hidden. This method involves a facilitator guiding participants through tasks while observing their behavior and reactions in real time. The insights gained can lead to meaningful improvements that enhance user satisfaction and product success. User participating in moderated usability testing session What Moderated Usability Testing Involves Moderated usability testing is a hands-on approach where a facilitator works directly with users. The facilitator introduces tasks, answers questions, and probes deeper into user thoughts and feelings. This interaction allows for immediate clarification and exploration of user behavior. Key elements include: Real-time observation: Watching users navigate the product live. Task-based scenarios: Users complete specific actions to test functionality. Open-ended questions: Facilitators ask about user decisions and frustrations. Note-taking and recording: Sessions are documented for later analysis. This approach contrasts with unmoderated testing, where users complete tasks independently without guidance. Moderated testing provides richer qualitative data and the chance to adapt the session based on user responses. Benefits of Moderated Usability Testing Moderated usability testing offers several advantages that help teams gain deeper insights: Immediate feedback: Facilitators can ask follow-up questions to understand why users behave a certain way. Contextual understanding: Observing users in real time reveals emotional reactions and non-verbal cues. Flexibility: The facilitator can adjust tasks or explore unexpected issues as they arise. Higher engagement: Users often feel more comfortable asking questions or expressing confusion. For example, a software company testing a new dashboard found that users struggled with navigation. The facilitator’s questions uncovered that terminology was unclear, leading to a redesign that improved clarity and reduced errors. Preparing for a Successful Session Preparation is crucial for effective moderated usability testing. Here are steps to ensure productive sessions: Define clear goals: Know what you want to learn, such as testing a new feature or overall navigation. Recruit representative users: Select participants who match your target audience. Create realistic tasks: Design scenarios that reflect actual user goals. Prepare a script: Outline instructions and questions to keep the session focused. Set up the environment: Ensure technology works smoothly and the setting is comfortable. A well-prepared session minimizes distractions and maximizes the quality of insights. Techniques to Enhance Moderated Usability Testing To get the most from moderated sessions, facilitators can use several techniques: Think-aloud protocol: Encourage users to verbalize their thoughts while completing tasks. This reveals their reasoning and confusion points. Probing questions: Ask users to explain why they took certain actions or what they expected to happen. Silent observation: Sometimes step back and watch without interrupting to capture natural behavior. Note key moments: Record moments of hesitation, frustration, or delight for later review. Use screen sharing or recording: Capture interactions for detailed analysis and sharing with the team. For instance, during a mobile app test, a facilitator noticed a user hesitating before tapping a button. Asking why revealed the icon was unclear, prompting a design change. Facilitator documenting user behavior in moderated usability testing Analyzing and Applying Findings After testing, the real value comes from analyzing data and applying insights to improve the product. Steps include: Review recordings and notes: Identify patterns and recurring issues. Categorize problems: Group issues by severity and type (e.g., navigation, content clarity). Prioritize fixes: Focus on changes that will have the biggest impact on user experience. Share findings: Present results with clear examples to stakeholders. Iterate design: Implement changes and plan follow-up testing to verify improvements. For example, a website redesign team used moderated testing to find that users missed key calls to action. They adjusted button placement and wording, then confirmed success in a second round of testing. When to Use Moderated Usability Testing This method works best when you need detailed insights and user interaction is complex. It suits: Early-stage prototypes: To catch major usability issues before development. New features: To understand how users adapt and what confuses them. Complex workflows: When tasks involve multiple steps or decisions. High-stakes products: Where user errors have serious consequences. Moderated testing requires more resources than unmoderated methods but delivers richer data that can justify the investment.

By Philip Burgess | UX Research Leader Diary studies offer a unique window into people's daily lives, capturing behaviors, thoughts, and emotions as they happen. Unlike traditional research methods that rely on recall or one-time observations, diary studies collect data over time, providing rich, detailed insights. This approach helps researchers understand patterns and contexts that might otherwise be missed. Diary with handwritten notes and pen What Are Diary Studies? Diary studies involve participants recording their experiences, activities, or feelings regularly over a set period. These records can be written, audio, video, or digital entries. The goal is to gather data that reflects real-life situations as they unfold, rather than relying on memory or artificial settings. This method suits research areas such as psychology, healthcare, education, and user experience design. For example, a study on sleep habits might ask participants to log their bedtime routines and sleep quality each morning. This ongoing data collection reveals trends and triggers that one-time surveys cannot capture. Advantages of Diary Studies Diary studies provide several benefits that make them valuable in research: Rich, Contextual Data Participants share details about their environment, mood, and actions, offering a fuller picture than simple yes/no answers. Reduced Recall Bias Since entries are made close to the event, the information is more accurate than relying on memory days or weeks later. Longitudinal Insights Tracking changes over days or weeks helps identify patterns, habits, and the impact of external factors. Participant Empowerment People control what and when they report, which can lead to more honest and thoughtful responses. Flexibility in Data Collection Diaries can be adapted to different formats and technologies, from paper journals to smartphone apps. Practical Examples of Diary Studies To illustrate the power of diary studies, consider these examples: Healthcare Monitoring Patients with chronic conditions like diabetes use diaries to record symptoms, medication intake, and lifestyle factors. This data helps doctors tailor treatments and spot early warning signs. User Experience Research Designers ask users to document their interactions with a product over time. This reveals usability issues and emotional responses that lab tests might miss. Educational Research Students keep learning diaries to reflect on their study habits and challenges. Educators use this feedback to improve teaching methods. Mental Health Tracking Individuals log moods and triggers daily, assisting therapists in understanding emotional patterns and adjusting therapy plans. Challenges and How to Overcome Them Diary studies are not without challenges. Common issues include participant fatigue, inconsistent entries, and privacy concerns. Here are strategies to address these: Keep Entries Short and Simple Design prompts that take only a few minutes to complete, reducing the burden on participants. Use Reminders and Incentives Regular notifications and rewards encourage consistent participation. Ensure Confidentiality Clearly communicate how data will be stored and used to build trust. Provide Training and Support Help participants understand the purpose and process to improve data quality. Tools and Technologies for Diary Studies Modern technology has expanded diary study options. Mobile apps allow instant entries with text, photos, or voice notes. Some apps include features like: Time-stamped entries Automated reminders Data export for analysis Multimedia support For example, a health app might prompt users to record pain levels several times a day, combining text and voice input. This makes participation easier and data richer. Smartphone showing diary app with daily entries Tips for Conducting Effective Diary Studies To get the most from diary studies, researchers should: Define clear objectives and tailor diary prompts accordingly Choose the right format for the target audience Pilot test the diary process to identify issues early Monitor data collection and provide feedback to participants Analyze entries systematically, looking for themes and changes over time

By Philip Burgess | UX Research Leader User experience (UX) design shapes how people interact with websites, apps, and digital products. But how do designers know which version of a design works best? A/B testing provides a clear answer by comparing two versions of a design to see which performs better. This method helps UX researchers make decisions based on real user behavior instead of assumptions. Comparing two webpage designs in A/B testing What Is A/B Testing in UX? A/B testing, also called split testing, involves showing two variants of a webpage or app screen to different groups of users at the same time. One version is the control (A), and the other is the variation (B). By tracking how users interact with each version, researchers identify which design leads to better outcomes, such as more clicks, longer engagement, or higher conversion rates. This method removes guesswork from design decisions. Instead of relying on opinions or intuition, UX teams use data to guide improvements. For example, a company might test two button colors to see which one encourages more sign-ups. Why A/B Testing Matters in UX Research UX research aims to create designs that meet user needs and business goals. A/B testing supports this by: Validating design changes before full implementation Reducing risks by testing ideas on a smaller scale Improving user satisfaction through data-driven design Increasing conversion rates by identifying effective elements Without testing, teams might launch changes that confuse users or reduce engagement. A/B testing provides evidence to back design choices and helps prioritize features that truly matter. How to Run an Effective A/B Test Running a successful A/B test requires careful planning and execution. Here are the key steps: 1. Define Clear Goals Start by deciding what you want to improve. Goals could include increasing click-through rates, reducing bounce rates, or boosting purchases. Clear goals help focus the test and measure success. 2. Identify the Element to Test Choose one specific element to change between versions. This could be a headline, button color, layout, or image. Testing multiple changes at once makes it hard to know which caused the difference. 3. Create Variations Design the control (A) and the variation (B). Keep the changes simple and focused. For example, if testing a call-to-action button, only change its color or text. 4. Split Your Audience Randomly divide your users into two groups. One group sees version A, the other sees version B. This ensures unbiased results. 5. Collect Data Track user interactions relevant to your goal. Use analytics tools to measure clicks, time spent, conversions, or other metrics. 6. Analyze Results Compare the performance of both versions using statistical methods. Determine if the difference is significant or due to chance. 7. Implement the Winner If one version clearly outperforms the other, roll out that design to all users. If results are inconclusive, consider testing other elements or running the test longer. Examples of A/B Testing in UX Example 1: Improving Signup Rates An online newsletter wanted more people to subscribe. The team tested two versions of the signup form: one with a short form asking only for email, and another with a longer form requesting name and email. The shorter form increased signups by 25%, showing that simplicity encouraged more users to complete the form. Example 2: Boosting E-commerce Sales An e-commerce site tested two product page layouts. Version A had product images on the left and description on the right. Version B reversed this order. The test revealed that Version B led to a 15% increase in add-to-cart clicks, suggesting users preferred seeing the description first. Tablet showing two app screen designs for A/B testing Best Practices for UX Researchers Using A/B Testing Test one change at a time to isolate effects Run tests long enough to gather sufficient data, avoiding premature conclusions Use a large enough sample size to ensure results are reliable Consider user segments to see if different groups respond differently Combine A/B testing with qualitative research like user interviews for deeper insights Common Pitfalls to Avoid Testing too many elements simultaneously, which confuses results Ignoring statistical significance and acting on random fluctuations Running tests during unusual traffic periods, which skews data Overlooking mobile users or other important audience segments Final Thoughts on A/B Testing in UX Research A/B testing offers a practical way to improve user experience by grounding design decisions in real user data. It helps UX researchers identify what works and what does not, leading to better products and happier users. By following clear goals, testing carefully, and analyzing results thoughtfully, teams can make steady progress in creating designs that truly connect with their audience.

By Philip Burgess | UX Research Leader Unmoderated usability testing has become a powerful tool for product teams aiming to understand how real users interact with their products. Unlike traditional moderated sessions, this approach allows users to complete tasks independently, providing authentic insights into user behavior. This post explores how unmoderated usability testing can improve product development by offering practical benefits, real-world examples, and tips for effective implementation. Unmoderated usability testing interface on laptop screen What Is Unmoderated Usability Testing? Unmoderated usability testing involves users interacting with a product or prototype without a facilitator guiding them. Participants complete predefined tasks in their own environment and time, often using specialized software that records their actions, clicks, and sometimes screen recordings or audio feedback. This method contrasts with moderated testing, where a facilitator observes and interacts with users in real time. Unmoderated testing offers flexibility and scale, making it easier to gather data from diverse users quickly. Why Choose Unmoderated Usability Testing? Access to Real User Behavior When users complete tasks without a moderator, their behavior tends to be more natural. They are less likely to feel observed or pressured, which reduces bias. This leads to more accurate insights into how users navigate the product, where they struggle, and what features they find intuitive. Cost and Time Efficiency Unmoderated testing can be set up and launched quickly, often reaching dozens or hundreds of users simultaneously. This reduces the time and cost compared to scheduling individual moderated sessions. Teams can collect large amounts of data in days rather than weeks. Flexibility for Participants Users can complete tasks at their convenience, using their own devices and environments. This flexibility increases participation rates and provides insights into how the product performs in real-world conditions, including different devices, browsers, and network speeds. How Unmoderated Usability Testing Supports Product Development Early Detection of Usability Issues By testing early prototypes or new features with real users, teams can identify usability problems before investing in full development. For example, a startup testing a new mobile app feature found that users struggled to locate the settings menu. This insight led to a redesign that improved navigation and reduced support requests after launch. Data-Driven Design Decisions Unmoderated testing generates quantitative data such as task completion rates, time on task, and error frequency. These metrics help teams prioritize fixes and enhancements based on actual user difficulties rather than assumptions. Continuous Improvement Because unmoderated tests are easy to run repeatedly, teams can use them throughout the product lifecycle. After releasing updates, they can verify if changes improved usability or introduced new issues. This ongoing feedback loop supports iterative development and better user experiences. User interacting with tablet during unmoderated usability test Best Practices for Running Unmoderated Usability Tests Define Clear Tasks and Goals Write simple, specific tasks that reflect real user goals. Avoid vague instructions. For example, instead of "Explore the app," use "Find and add a product to your shopping cart." Choose the Right Tools Select platforms that support screen recording, click tracking, and user feedback collection. Popular tools include UserTesting, Lookback, and Maze. Ensure the tool fits your budget and testing needs. Recruit Representative Users Target participants who match your product’s user base. This ensures the feedback is relevant and actionable. Use screening questions to filter out unqualified testers. Analyze Both Quantitative and Qualitative Data Look beyond numbers. Watch recordings or read user comments to understand why users behave a certain way. This context reveals deeper insights into pain points and motivations. Keep Tests Short and Focused Limit tests to 15-20 minutes to maintain participant engagement. Focus on critical tasks that reveal the most about usability. Examples of Unmoderated Usability Testing in Action E-commerce Website : A retailer used unmoderated testing to evaluate their checkout process. They discovered that many users abandoned the cart at the payment step due to confusing form fields. Simplifying the form increased conversion rates by 12%. SaaS Dashboard : A software company tested a new analytics dashboard feature. Users struggled to find key metrics. The team redesigned the layout based on feedback, improving task completion by 30%. Mobile Game : A game developer tested onboarding flows. Players dropped off during tutorial levels. Insights led to shorter tutorials and clearer instructions, boosting retention. Limitations to Consider Unmoderated usability testing is not a complete replacement for moderated sessions. It lacks real-time interaction, so you cannot ask follow-up questions or clarify confusion immediately. Some complex tasks may require observation to understand user thought processes fully. Also, participants may skip tasks or provide less detailed feedback without a moderator’s encouragement. Combining unmoderated testing with other research methods often yields the best results.

By Philip Burgess | UX Research Leader Understanding why customers choose a product or service is key to creating solutions that truly meet their needs. Jobs-to-be-Done (JTBD) interviews offer a powerful way to uncover these motivations by focusing on the tasks customers want to accomplish. This method goes beyond traditional surveys or focus groups by exploring the underlying reasons behind customer behavior. JTBD interviews help businesses discover what drives customer decisions, revealing opportunities for innovation and improvement. This post explains how to conduct these interviews effectively and use the insights to build better products and services. Taking detailed notes during a Jobs-to-be-Done interview What Are Jobs-to-be-Done Interviews? Jobs-to-be-Done interviews focus on understanding the "job" a customer hires a product or service to do. Instead of asking what features customers want, these interviews explore the context, motivations, and desired outcomes behind their choices. For example, a person might buy a drill not because they want a drill itself, but because they want to make a hole in the wall. The "job" is making the hole, and the drill is just the tool to get it done. JTBD interviews dig into these real needs and the circumstances that shape them. Preparing for JTBD Interviews Preparation is crucial for successful JTBD interviews. Here are some key steps: Define the job clearly : Know which customer job you want to explore. It could be a task, goal, or problem your product aims to solve. Select the right participants : Choose customers who have recently hired a product or service for that job. Recent experiences provide clearer insights. Create open-ended questions : Avoid yes/no questions. Instead, ask about the situation, what triggered the need, and how they went about solving it. Plan for storytelling : Encourage interviewees to share stories about their experiences. Stories reveal emotions and context that simple answers miss. Conducting the Interview During the interview, focus on listening and guiding the conversation without leading it. Use these techniques: Start with context : Ask about the situation that led to the job. For example, "Can you tell me about the last time you needed to [job]?" Explore the process : Find out what steps they took, what alternatives they considered, and what challenges they faced. Identify outcomes : Ask what a successful result looked like and what frustrations or obstacles appeared. Probe for emotions : Understanding feelings helps reveal hidden needs and priorities. Avoid pitching your product or interrupting. The goal is to understand the customer's perspective fully. Analyzing JTBD Interview Data After collecting interview data, look for patterns and themes that reveal the core job and related needs. Here’s how to analyze effectively: Group similar stories : Cluster responses that describe the same job or outcome. Identify triggers : What events or problems caused the customer to seek a solution? Highlight struggles : Note common frustrations or barriers customers encountered. Map desired outcomes : What do customers want to achieve beyond just completing the job? This analysis helps create a clear picture of the job and how well current solutions meet it. Visual mapping of Jobs-to-be-Done interview findings on a whiteboard Using JTBD Insights to Improve Products Once you understand the job and customer needs, use these insights to guide product development: Focus on outcomes : Design features that help customers achieve their desired results more easily. Address pain points : Solve common frustrations uncovered during interviews. Explore new opportunities : Identify unmet needs or alternative jobs customers want to get done. Test assumptions : Use JTBD findings to validate ideas before investing in development. For example, a company that learned customers struggled with complicated setup might simplify onboarding or offer better support resources. Tips for Successful JTBD Interviews Be patient and curious : Customers may need time to recall details. Encourage them gently. Record interviews : With permission, recording helps capture nuances for later review. Avoid jargon : Use simple language to keep the conversation natural. Practice active listening : Reflect back what you hear to confirm understanding. Follow up : Sometimes a second conversation uncovers deeper insights. Final Thoughts on JTBD Interviews Jobs-to-be-Done interviews reveal the real reasons customers choose products and services. By focusing on the job rather than the product, businesses gain clear guidance on how to improve and innovate. The process requires careful preparation, skilled interviewing, and thoughtful analysis, but the payoff is a stronger connection to customer needs. Start by identifying a key job your product supports, then talk to customers who recently hired a solution for that job. Use their stories to uncover what works, what doesn’t, and what could be better. This approach leads to products that truly fit customer lives and stand out in the market.

By Philip Burgess | UX Research Leader Focus groups remain one of the most valuable tools for gathering detailed feedback and understanding the opinions of a target audience. When done well, they provide rich insights that surveys or one-on-one interviews might miss. Yet, many focus groups fall short because of poor planning or execution. This post explores practical strategies to help you run focus groups that deliver clear, actionable results. Participants engaged in a focus group discussion Planning Your Focus Group The foundation of a successful focus group is thorough planning. Start by defining your objective clearly. What specific information do you want to learn? For example, if you are testing a new product concept, your goal might be to understand initial reactions, perceived benefits, and concerns. Next, select participants who represent your target audience. Avoid mixing very different groups in one session, as this can dilute the discussion. For instance, if you are researching preferences for a youth-oriented app, recruit participants within the relevant age range and interests. Choose a comfortable, quiet location that encourages open conversation. The setting should feel informal but organized. Arrange seating in a circle or semi-circle to promote eye contact and interaction. Crafting Effective Questions The questions you ask shape the quality of the discussion. Use open-ended questions that invite detailed responses rather than yes/no answers. For example, instead of asking “Do you like this product?” ask “What do you think about this product’s features?” Prepare a discussion guide with a logical flow. Begin with general questions to warm up the group, then move to more specific topics. Include prompts to encourage participants to explain their thoughts or compare ideas. Avoid leading questions that suggest a preferred answer. For example, do not say “How much do you like this feature?” Instead, ask “What are your thoughts on this feature?” Moderating the Session The moderator plays a crucial role in guiding the conversation and ensuring everyone participates. A skilled moderator listens actively, asks follow-up questions, and manages dominant voices to give quieter members a chance to speak. Start the session by setting ground rules: respect all opinions, one person speaks at a time, and there are no right or wrong answers. This helps create a safe space for honest feedback. Use techniques like summarizing what participants say to confirm understanding. For example, “So you feel this feature is too complicated, is that correct?” This shows you value their input and keeps the discussion on track. Encouraging Honest Feedback Participants may hesitate to share negative opinions if they feel judged or pressured. To encourage honesty, emphasize that all feedback is valuable and will be kept confidential. Use icebreakers or warm-up questions to build rapport early on. For example, ask participants to share a recent experience related to the topic before diving into product-specific questions. Consider using anonymous methods alongside the group discussion, such as written notes or digital polling, to capture sensitive opinions. Moderator actively listening and taking notes during a focus group Analyzing and Using the Results After the session, review your notes and recordings carefully. Look for common themes, surprising insights, and conflicting opinions. Group similar comments to identify patterns. Share the findings with your team in a clear, concise format. Use quotes from participants to illustrate key points and bring the data to life. Apply the insights to improve your product, service, or strategy. For example, if multiple participants mention difficulty navigating an app, prioritize simplifying the user interface. Tips for Virtual Focus Groups Virtual focus groups have become common and offer flexibility. To succeed online, ensure all participants have stable internet and understand how to use the platform. Send clear instructions and a schedule in advance. Use video to capture nonverbal cues but be prepared for some participants to turn off cameras. Keep sessions shorter than in-person meetings, around 60 to 90 minutes, to maintain engagement. Use interactive tools like polls or chat to encourage participation.

By Philip Burgess | UX Research Leader Ethnography offers a unique window into human cultures, allowing researchers to observe and understand social behaviors, traditions, and everyday life from an insider’s perspective. Unlike surveys or experiments, ethnography immerses the researcher in the community, providing rich, detailed insights that other methods often miss. This post explores what ethnography is, how it works, and why it remains a vital tool for uncovering the complexities of cultures around the world. Researcher documenting cultural practices in a village What Is Ethnography? Ethnography is a qualitative research method rooted in anthropology and sociology. It involves studying people in their natural environments to understand their customs, rituals, and social interactions. The goal is to capture the lived experiences of individuals and groups, revealing how culture shapes their worldview. Ethnographers typically spend extended periods living within the community they study. This close contact helps build trust and allows researchers to observe behaviors that participants might not mention in interviews or surveys. The method relies heavily on participant observation, interviews, and field notes. How Ethnography Works Ethnographic research follows several key steps: Preparation: Researchers identify the community or group they want to study and define research questions. Entry: Gaining access to the community often requires building relationships and obtaining permission. Observation: Researchers observe daily life, rituals, and interactions, often participating in activities to gain deeper insight. Interviews: Informal and formal interviews help clarify observations and gather personal stories. Documentation: Detailed field notes, audio recordings, and sometimes photographs capture the data. Analysis: Researchers analyze patterns, themes, and meanings within the collected data. Reporting: Findings are shared through narratives that reflect the community’s perspective. For example, an ethnographer studying a remote fishing village might live there for months, joining fishing trips, attending local festivals, and talking with residents about their traditions and challenges. This immersive approach reveals nuances that surveys alone cannot capture. Why Ethnography Matters Ethnography provides depth and context that quantitative methods often lack. It helps uncover the reasons behind behaviors and social norms, not just the behaviors themselves. This method is valuable in many fields: Anthropology: Understanding human societies and cultural evolution. Education: Exploring classroom dynamics and student experiences. Healthcare: Studying patient behaviors and cultural attitudes toward illness. Business: Learning how consumers interact with products in real-life settings. Ethnographic insights can improve policies, design better products, and foster cross-cultural understanding. For instance, a healthcare ethnographer might discover that certain cultural beliefs affect how patients follow medical advice, leading to more effective communication strategies. Challenges in Ethnographic Research Ethnography requires patience, flexibility, and cultural sensitivity. Researchers must navigate ethical concerns, such as respecting privacy and avoiding exploitation. The long time commitment and potential language barriers can also pose difficulties. Moreover, ethnographers must remain aware of their own biases and how their presence might influence the community. Maintaining objectivity while building relationships is a delicate balance. Practical Tips for Conducting Ethnography If you plan to conduct ethnographic research, consider these tips: Build trust gradually: Relationships take time; be patient and respectful. Be open-minded: Expect surprises and be ready to adapt your approach. Take detailed notes: Record observations promptly to avoid losing important details. Use multiple methods: Combine observation with interviews and document analysis. Reflect on your role: Regularly assess how your presence affects the research. Ethnography is not just about collecting data but about understanding people’s lives in a holistic way. Field notes and voice recorder used during ethnographic research Examples of Ethnographic Studies One famous ethnographic study is Bronislaw Malinowski’s work with the Trobriand Islanders in the early 20th century. By living with the islanders, he documented their social structures, rituals, and economic systems, challenging Western assumptions about “primitive” societies. More recently, ethnographers have studied urban communities to understand how people navigate social inequalities or how technology shapes daily life. For example, researchers living in a low-income neighborhood might explore how residents create support networks despite economic hardship. Final Thoughts Ethnography reveals the richness of human cultures by placing researchers directly in the environments they study. This method uncovers the meanings behind actions and traditions, offering insights that help us understand each other better. Whether you are a student, professional, or curious reader, appreciating ethnography’s approach can deepen your view of the world. To explore ethnography further, consider reading classic studies or trying simple participant observation in your own community. Observing and listening closely can open doors to new perspectives and greater empathy.

By Philip Burgess | UX Research Leader Designing products that truly meet user needs requires more than assumptions or surface-level feedback. Contextual inquiry offers a powerful way to understand users by observing and engaging with them in their natural environment. This method reveals insights that traditional interviews or surveys often miss, leading to better, more user-centered designs. Contextual inquiry is a research technique where designers or researchers observe users as they perform tasks in their usual setting. The goal is to uncover real behaviors, challenges, and motivations by seeing how users interact with products or systems in context. This approach helps teams build empathy and design solutions grounded in actual user experiences. What Makes Contextual Inquiry Different Unlike other research methods that rely on self-reported data, contextual inquiry focuses on direct observation and conversation in the moment. Users often cannot fully articulate their needs or pain points when asked in isolation. Watching them work reveals hidden steps, workarounds, and frustrations that might otherwise go unnoticed. Key features of contextual inquiry include: Observation in the user’s environment : Researchers visit the place where the user naturally works or uses the product. Collaborative conversation : The researcher asks questions while the user performs tasks, encouraging explanation and reflection. Focus on real tasks : The inquiry centers on actual work or activities, not hypothetical scenarios. Iterative learning : Insights from one session inform the next, deepening understanding over time. This method uncovers the why behind user actions, not just the what . It also highlights environmental factors like tools, interruptions, or social dynamics that influence behavior. Researcher observing user in natural setting Observation in the user’s natural workspace reveals authentic behavior and context. How Contextual Inquiry Improves Design Outcomes Contextual inquiry leads to stronger design decisions by providing rich, detailed insights. Here are some ways it benefits user-centered design: Identifies unmet needs Users may not know or express what they want, but their actions reveal gaps. For example, a user might repeatedly switch between apps to complete a task, signaling a need for integration. Reveals workarounds and frustrations Seeing users create shortcuts or avoid certain features shows where the design falls short. This helps prioritize fixes that improve usability. Supports empathy and user understanding Designers gain a deeper connection to users’ daily lives, making it easier to design with their perspective in mind. Validates assumptions with real data Instead of guessing, teams base decisions on observed behavior, reducing the risk of costly mistakes. Informs feature prioritization Understanding which tasks are most critical or time-consuming helps focus development efforts on what matters most. For example, a team designing software for healthcare professionals used contextual inquiry to observe nurses during their shifts. They discovered that nurses frequently used paper notes to track patient information because the digital system was too slow. This insight led to redesigning the interface for faster data entry, improving workflow and reducing errors. Steps to Conduct a Successful Contextual Inquiry To get the most from contextual inquiry, follow these practical steps: Define clear goals Know what you want to learn. Focus on specific tasks or user groups. Select representative users Choose participants who reflect your target audience and use the product in typical ways. Plan the visit Arrange to observe users in their actual environment. Prepare questions but stay flexible. Build rapport Explain the purpose and encourage users to think aloud as they work. Observe and ask questions Watch carefully, note behaviors, and ask about motivations or challenges without interrupting flow. Record findings Take detailed notes, photos, or recordings (with permission) to capture context. Analyze and share insights Look for patterns, surprises, and opportunities. Share findings with the design team to inform decisions. Detailed notes and sketches from user observation Careful documentation during inquiry sessions captures valuable insights for design teams. Common Challenges and How to Overcome Them Contextual inquiry can be demanding but manageable with the right approach: User discomfort Some users may feel nervous being observed. Build trust by explaining the process and emphasizing there are no right or wrong actions. Interruptions to workflow Avoid disrupting users’ tasks. Schedule sessions during less busy times or observe without interfering. Data overload The volume of information can be overwhelming. Focus on key goals and use structured note-taking to stay organized. Researcher bias Stay open-minded and avoid jumping to conclusions. Use multiple sessions and team discussions to validate findings. Applying Contextual Inquiry Beyond Product Design While common in software and product design, contextual inquiry also benefits other fields: Healthcare : Understanding patient and provider interactions to improve care delivery. Education : Observing classroom dynamics to develop better learning tools. Retail : Studying shopper behavior to enhance store layouts and services. Manufacturing : Analyzing worker processes to increase safety and efficiency. This method’s strength lies in its ability to reveal real-world behavior, making it valuable wherever user experience matters. Understanding users in their natural context uncovers insights that drive meaningful design improvements. Contextual inquiry helps teams move beyond assumptions to create products that fit seamlessly into users’ lives. By observing, listening, and learning from real experiences, designers can build solutions that truly support and delight users.