Friday: Test with Real Users skill

Friday is the payoff.

by wondelai·MIT license·★ 2,235 Stars on the repo·GitHub ↗

Use now

Files of Friday: Test with Real Users

wondelai/main1 file
friday.md
Show the full text317 lines

Friday: Test with Real Users

Friday is the payoff. Five customers interact with the prototype while the team watches, listens, and takes notes. By the end of the day, the team will have clear evidence of what works, what fails, and what to do next. The quality of Friday depends entirely on the quality of the interviews and the discipline of the observation.

Table of Contents

  1. Schedule Overview
  2. The Five-Act Interview Script
  3. Interviewer Techniques
  4. Observation Room Setup
  5. Pattern Recognition
  6. End-of-Sprint Debrief
  7. Templates
  8. Common Friday Mistakes

Schedule Overview

Time Activity Duration
9:00 - 9:30 Setup interview and observation rooms 30 min
9:30 - 9:45 Interviewer warm-up and team briefing 15 min
9:45 - 10:30 Interview 1 45 min
10:30 - 11:00 Break and team discussion 30 min
11:00 - 11:45 Interview 2 45 min
11:45 - 12:15 Break and team discussion 30 min
12:15 - 1:00 Interview 3 45 min
1:00 - 1:45 Lunch 45 min
1:45 - 2:30 Interview 4 45 min
2:30 - 3:00 Break and team discussion 30 min
3:00 - 3:45 Interview 5 45 min
3:45 - 5:00 Pattern recognition and debrief 75 min

The Five-Act Interview Script

Act 1: Friendly Welcome (5 minutes)

Goal: Make the participant comfortable, set expectations, get consent.

Script:

"Hi, thanks for coming in today. My name is [name] and I will be walking you through some things we are working on. Before we begin, I want to make sure you know there are no right or wrong answers. We are testing the product, not you. If something is confusing, that is our fault, not yours.

I am going to ask you to think aloud as you go. Just tell me what you are looking at, what you are trying to do, and what you are thinking. This is really helpful for us.

We have a few people from the team watching in another room so they can hear your feedback directly. And with your permission, we would like to record the session so we can review it later. Is that okay?

Great. Do you have any questions before we start?"

Act 2: Context Questions (5 minutes)

Goal: Understand the participant's background, current behavior, and mindset before showing the prototype.

Example questions by product type:

Product Type Context Questions
Project management tool "Tell me about how you currently keep track of projects at work. What tools do you use? What is frustrating about your current setup?"
E-commerce "When was the last time you bought [category] online? Walk me through how you found and chose what to buy."
Healthcare app "How do you currently manage your [condition]? What does a typical week look like?"
B2B platform "Tell me about your role. When you need to [task], how do you handle that today?"
Act 3: Introduce the Prototype (5 minutes)

Goal: Show the entry point and observe the first impression without explaining anything.

Script:

"Now I am going to show you something we have been working on. Some parts might work, some might not. That is totally normal. I did not design this, so please be honest. You will not hurt my feelings.

[Show the first screen of the prototype]

Take a look at this. Without clicking anything, tell me: what is this? What do you think you can do here? Who do you think this is for?"

Critical rule: Do not explain the prototype. If they are confused, that is data. Let the silence sit. Resist the urge to help.

Act 4: Tasks and Nudges (15 minutes)

Goal: Watch the participant attempt realistic tasks with the prototype.

Setting up tasks:

"Great. Now I would like you to try a few things. Remember, think aloud as you go."

Task format:

Use scenario-based tasks, not instructions:

Weak Task (Avoid) Strong Task (Use)
"Click the signup button" "You heard about this from a friend and want to try it"
"Go to the pricing page" "You are interested but need to figure out if it fits your budget"
"Create a new project" "You just joined this tool and want to set up your first project for your marketing team"
"Find the search bar" "You are looking for a specific type of [product]. How would you find it?"

Nudge techniques when the participant gets stuck:

Situation Nudge
Participant goes silent "What are you thinking right now?"
Participant is stuck "What would you expect to happen?"
Participant asks for help "What would you try if I were not here?"
Participant clicks a dead end "Interesting. In a real version, that would work. For now, let me take you to the next screen."
Participant goes off the path "That is great feedback. For the next task, let me show you this screen."
Act 5: Debrief (5 minutes)

Goal: Capture the participant's overall impressions and ask targeted follow-up questions.

Debrief questions:

  1. "What was your overall impression?"
  2. "What stood out to you, either positively or negatively?"
  3. "Who do you think this is for?"
  4. "Would you use this? Why or why not?"
  5. "How does this compare to what you use today?"
  6. "If you could change one thing, what would it be?"

Also ask follow-up questions tied to your specific sprint questions. Close by asking if there is anything else they would like to share and thanking them for their time.

Interviewer Techniques

Staying Neutral
Do Do Not
Nod and say "mm-hmm" Say "great job" or "that is right"
Ask "tell me more about that" Say "actually, you are supposed to click here"
Pause and let silence work Fill silence with explanations
Mirror their words: "You said it felt confusing?" Defend the design: "Well, the idea is that..."
Take notes on a pad Type loudly on a laptop
The Power of Silence

When a participant pauses, wait at least 5 seconds before speaking. Most people will fill the silence with their thoughts, which are the most valuable data you can collect.

Handling Difficult Moments
Moment Response
Participant says "I hate this" "Tell me more. What specifically is not working for you?"
Participant gives only positive feedback "If a friend asked you about this, what would you warn them about?"
Participant asks "Am I doing this right?" "There is no right or wrong. What would you try?"
Participant is clearly frustrated "I can see this is frustrating. That is really useful feedback. Let's move to the next thing."
Participant finishes too quickly "Let's go back to [screen]. What were you thinking when you saw this?"

Observation Room Setup

The Note-Taking Grid

Draw this on the whiteboard before the first interview:

                | Customer 1 | Customer 2 | Customer 3 | Customer 4 | Customer 5 |
|---------------|------------|------------|------------|------------|------------|
| First impression |         |            |            |            |            |
| [Screen/Task 1]  |        |            |            |            |            |
| [Screen/Task 2]  |        |            |            |            |            |
| [Screen/Task 3]  |        |            |            |            |            |
| [Key question 1] |        |            |            |            |            |
| [Key question 2] |        |            |            |            |            |
| Overall reaction |         |            |            |            |            |

Row labels come from the storyboard frames and sprint questions. Add 7-10 rows that correspond to the key moments you want to test.

How to Take Notes
  1. Each team member writes observations on sticky notes during the interview
  2. Use one color per team member (so you can trace who observed what)
  3. After each interview, place sticky notes in the appropriate grid cell
  4. Mark each note with a symbol:
    • Checkmark for positive reactions, successful completions, or enthusiastic comments
    • X for negative reactions, failures, confusion, or complaints
    • Tilde (~) for neutral, mixed, or ambiguous reactions

Pattern Recognition

After All Five Interviews
  1. Step back and look at the entire grid
  2. Read across each row: do you see mostly checkmarks, mostly Xs, or a mix?
  3. Highlight rows with strong patterns (4-5 of the same symbol)
Pattern Categories
Pattern What It Means Example
5 checkmarks Strong validation. This works All 5 users understood the pricing immediately
4 checkmarks, 1 X Mostly works, investigate the outlier 4 of 5 completed onboarding, 1 got stuck on step 3
3 checkmarks, 2 Xs Mixed signal, needs refinement Some users loved the AI suggestions, others did not trust them
2 checkmarks, 3 Xs Significant problem Most users could not find the search function
5 Xs Clear failure. This does not work Nobody understood the value proposition on the landing page
All tildes Indifference (arguably worse than failure) Users did not care about the feature either way
Minimum Viable Signal
  • 3 out of 5 participants showing the same pattern is a meaningful signal
  • 5 out of 5 is a strong signal that demands action
  • 2 out of 5 is inconclusive and may require further testing

End-of-Sprint Debrief

Step 1: Review Sprint Questions (15 minutes)

Return to Monday's sprint questions. For each one:

  1. Read the question aloud
  2. Review the evidence from the grid
  3. Determine the answer: Yes, No, Partially, or Inconclusive

Template:

Sprint Question: Will first-time users understand what our product does?
Evidence: 4/5 correctly described the product on first impression. 1 was confused by the headline.
Answer: Yes, with minor copy improvements needed.
Step 2: Categorize Findings (20 minutes)

Organize all observations into three columns on the whiteboard:

What Worked (keep and build on):

  • List specific screens, features, or copy that received consistent positive feedback
  • Include direct quotes from participants

What Failed (fix or remove):

  • List specific moments of confusion, frustration, or failure
  • Note whether the failure was universal (5/5) or partial (3/5)

Mixed Results (investigate further):

  • List elements with split reactions
  • Note possible explanations for the split
Step 3: Decide Next Steps (20 minutes)
Friday Result Recommended Next Step
Core concept validated, minor issues Build the product. Fix the specific issues identified
Core concept validated, major UX issues Run a follow-up sprint focused on the problematic areas
Two concepts tested (Rumble), one won Build the winner. Document why the other lost
Core concept failed, but insights gained Pivot and run another sprint with a new approach
Everything failed Go back to Monday. Redefine the problem. The week saved you months
Inconclusive results Recruit 5 more users and test again, or rewrite the tasks

Templates

Interview Notes Template (Per Participant)
Participant: #[number]    Date/Time: [date, time]

FIRST IMPRESSION
What they said:
Understood the product: [ ] Yes [ ] No [ ] Partially

TASK 1: [Description]
Completed: [ ] Yes [ ] No [ ] With help
Notable quotes:

TASK 2: [Description]
Completed: [ ] Yes [ ] No [ ] With help
Notable quotes:

OVERALL DEBRIEF
Would they use this: [ ] Yes [ ] No [ ] Maybe
Key quote:
Sprint Results Summary Template
SPRINT: [Name]    DATE: [Week of]    TARGET: [Monday's target]

SPRINT QUESTIONS AND ANSWERS:
1. [Question] → [Answer with evidence]
2. [Question] → [Answer with evidence]
3. [Question] → [Answer with evidence]

WHAT WORKED:               WHAT FAILED:
- [Finding 1]              - [Finding 1]
- [Finding 2]              - [Finding 2]

NEXT STEPS:
- [ ] [Action item 1] — Owner: [Name] — Due: [Date]
- [ ] [Action item 2] — Owner: [Name] — Due: [Date]

Common Friday Mistakes

The Interviewer Explains the Prototype

Problem: When a user gets confused, the interviewer says "Oh, this is supposed to be a dashboard where you can..." Fix: Practice the phrase "What would you expect to see here?" Let confusion happen. It is the most valuable data.

The Team Watches Passively

Problem: The observation team watches interviews like a movie without taking notes. Fix: Require sticky notes. Each person should produce 5-10 notes per interview. The grid on the whiteboard makes note-taking structured and accountable.

Skipping the Debrief

Problem: After the last interview, the team is exhausted and says "let's process this next week." Fix: The debrief is the most important hour of the entire sprint. Do it while observations are fresh. Waiting even one weekend degrades the team's memory and enthusiasm.

Recruiting the Wrong Users

Problem: The team tests with colleagues, friends, or people who do not match the target customer. Fix: Use a screener survey. Recruit people who match the customer profile defined on Monday. Test with strangers who have no loyalty to the team.

Over-Indexing on One Participant

Problem: One user gave dramatic negative feedback and the team panics. Fix: Wait for patterns. One negative reaction out of five may be an outlier. Three negative reactions out of five is a real signal.

1# Friday: Test with Real Users
2 
3Friday is the payoff. Five customers interact with the prototype while the team watches, listens, and takes notes. By the end of the day, the team will have clear evidence of what works, what fails, and what to do next. The quality of Friday depends entirely on the quality of the interviews and the discipline of the observation.
4 
5 
6## Table of Contents
71. [Schedule Overview](#schedule-overview)
82. [The Five-Act Interview Script](#the-five-act-interview-script)
93. [Interviewer Techniques](#interviewer-techniques)
104. [Observation Room Setup](#observation-room-setup)
115. [Pattern Recognition](#pattern-recognition)
126. [End-of-Sprint Debrief](#end-of-sprint-debrief)
137. [Templates](#templates)
148. [Common Friday Mistakes](#common-friday-mistakes)
15 
16---
17 
18## Schedule Overview
19 
20| Time | Activity | Duration |
21|------|----------|----------|
22| 9:00 - 9:30 | Setup interview and observation rooms | 30 min |
23| 9:30 - 9:45 | Interviewer warm-up and team briefing | 15 min |
24| 9:45 - 10:30 | Interview 1 | 45 min |
25| 10:30 - 11:00 | Break and team discussion | 30 min |
26| 11:00 - 11:45 | Interview 2 | 45 min |
27| 11:45 - 12:15 | Break and team discussion | 30 min |
28| 12:15 - 1:00 | Interview 3 | 45 min |
29| 1:00 - 1:45 | Lunch | 45 min |
30| 1:45 - 2:30 | Interview 4 | 45 min |
31| 2:30 - 3:00 | Break and team discussion | 30 min |
32| 3:00 - 3:45 | Interview 5 | 45 min |
33| 3:45 - 5:00 | Pattern recognition and debrief | 75 min |
34 
35## The Five-Act Interview Script
36 
37### Act 1: Friendly Welcome (5 minutes)
38 
39**Goal:** Make the participant comfortable, set expectations, get consent.
40 
41**Script:**
42 
43"Hi, thanks for coming in today. My name is [name] and I will be walking you through some things we are working on. Before we begin, I want to make sure you know there are no right or wrong answers. We are testing the product, not you. If something is confusing, that is our fault, not yours.
44 
45I am going to ask you to think aloud as you go. Just tell me what you are looking at, what you are trying to do, and what you are thinking. This is really helpful for us.
46 
47We have a few people from the team watching in another room so they can hear your feedback directly. And with your permission, we would like to record the session so we can review it later. Is that okay?
48 
49Great. Do you have any questions before we start?"
50 
51### Act 2: Context Questions (5 minutes)
52 
53**Goal:** Understand the participant's background, current behavior, and mindset before showing the prototype.
54 
55**Example questions by product type:**
56 
57| Product Type | Context Questions |
58|-------------|-------------------|
59| Project management tool | "Tell me about how you currently keep track of projects at work. What tools do you use? What is frustrating about your current setup?" |
60| E-commerce | "When was the last time you bought [category] online? Walk me through how you found and chose what to buy." |
61| Healthcare app | "How do you currently manage your [condition]? What does a typical week look like?" |
62| B2B platform | "Tell me about your role. When you need to [task], how do you handle that today?" |
63 
64### Act 3: Introduce the Prototype (5 minutes)
65 
66**Goal:** Show the entry point and observe the first impression without explaining anything.
67 
68**Script:**
69 
70"Now I am going to show you something we have been working on. Some parts might work, some might not. That is totally normal. I did not design this, so please be honest. You will not hurt my feelings.
71 
72[Show the first screen of the prototype]
73 
74Take a look at this. Without clicking anything, tell me: what is this? What do you think you can do here? Who do you think this is for?"
75 
76**Critical rule:** Do not explain the prototype. If they are confused, that is data. Let the silence sit. Resist the urge to help.
77 
78### Act 4: Tasks and Nudges (15 minutes)
79 
80**Goal:** Watch the participant attempt realistic tasks with the prototype.
81 
82**Setting up tasks:**
83 
84"Great. Now I would like you to try a few things. Remember, think aloud as you go."
85 
86**Task format:**
87 
88Use scenario-based tasks, not instructions:
89 
90| Weak Task (Avoid) | Strong Task (Use) |
91|-------------------|-------------------|
92| "Click the signup button" | "You heard about this from a friend and want to try it" |
93| "Go to the pricing page" | "You are interested but need to figure out if it fits your budget" |
94| "Create a new project" | "You just joined this tool and want to set up your first project for your marketing team" |
95| "Find the search bar" | "You are looking for a specific type of [product]. How would you find it?" |
96 
97**Nudge techniques when the participant gets stuck:**
98 
99| Situation | Nudge |
100|-----------|-------|
101| Participant goes silent | "What are you thinking right now?" |
102| Participant is stuck | "What would you expect to happen?" |
103| Participant asks for help | "What would you try if I were not here?" |
104| Participant clicks a dead end | "Interesting. In a real version, that would work. For now, let me take you to the next screen." |
105| Participant goes off the path | "That is great feedback. For the next task, let me show you this screen." |
106 
107### Act 5: Debrief (5 minutes)
108 
109**Goal:** Capture the participant's overall impressions and ask targeted follow-up questions.
110 
111**Debrief questions:**
112 
1131. "What was your overall impression?"
1142. "What stood out to you, either positively or negatively?"
1153. "Who do you think this is for?"
1164. "Would you use this? Why or why not?"
1175. "How does this compare to what you use today?"
1186. "If you could change one thing, what would it be?"
119 
120Also ask follow-up questions tied to your specific sprint questions. Close by asking if there is anything else they would like to share and thanking them for their time.
121 
122## Interviewer Techniques
123 
124### Staying Neutral
125 
126| Do | Do Not |
127|----|--------|
128| Nod and say "mm-hmm" | Say "great job" or "that is right" |
129| Ask "tell me more about that" | Say "actually, you are supposed to click here" |
130| Pause and let silence work | Fill silence with explanations |
131| Mirror their words: "You said it felt confusing?" | Defend the design: "Well, the idea is that..." |
132| Take notes on a pad | Type loudly on a laptop |
133 
134### The Power of Silence
135 
136When a participant pauses, wait at least 5 seconds before speaking. Most people will fill the silence with their thoughts, which are the most valuable data you can collect.
137 
138### Handling Difficult Moments
139 
140| Moment | Response |
141|--------|----------|
142| Participant says "I hate this" | "Tell me more. What specifically is not working for you?" |
143| Participant gives only positive feedback | "If a friend asked you about this, what would you warn them about?" |
144| Participant asks "Am I doing this right?" | "There is no right or wrong. What would you try?" |
145| Participant is clearly frustrated | "I can see this is frustrating. That is really useful feedback. Let's move to the next thing." |
146| Participant finishes too quickly | "Let's go back to [screen]. What were you thinking when you saw this?" |
147 
148## Observation Room Setup
149 
150### The Note-Taking Grid
151 
152Draw this on the whiteboard before the first interview:
153 
154```
155 | Customer 1 | Customer 2 | Customer 3 | Customer 4 | Customer 5 |
156|---------------|------------|------------|------------|------------|------------|
157| First impression | | | | | |
158| [Screen/Task 1] | | | | | |
159| [Screen/Task 2] | | | | | |
160| [Screen/Task 3] | | | | | |
161| [Key question 1] | | | | | |
162| [Key question 2] | | | | | |
163| Overall reaction | | | | | |
164```
165 
166**Row labels** come from the storyboard frames and sprint questions. Add 7-10 rows that correspond to the key moments you want to test.
167 
168### How to Take Notes
169 
1701. Each team member writes observations on sticky notes during the interview
1712. Use one color per team member (so you can trace who observed what)
1723. After each interview, place sticky notes in the appropriate grid cell
1734. Mark each note with a symbol:
174 - **Checkmark** for positive reactions, successful completions, or enthusiastic comments
175 - **X** for negative reactions, failures, confusion, or complaints
176 - **Tilde (~)** for neutral, mixed, or ambiguous reactions
177 
178## Pattern Recognition
179 
180### After All Five Interviews
181 
1821. Step back and look at the entire grid
1832. Read across each row: do you see mostly checkmarks, mostly Xs, or a mix?
1843. Highlight rows with strong patterns (4-5 of the same symbol)
185 
186### Pattern Categories
187 
188| Pattern | What It Means | Example |
189|---------|--------------|---------|
190| 5 checkmarks | Strong validation. This works | All 5 users understood the pricing immediately |
191| 4 checkmarks, 1 X | Mostly works, investigate the outlier | 4 of 5 completed onboarding, 1 got stuck on step 3 |
192| 3 checkmarks, 2 Xs | Mixed signal, needs refinement | Some users loved the AI suggestions, others did not trust them |
193| 2 checkmarks, 3 Xs | Significant problem | Most users could not find the search function |
194| 5 Xs | Clear failure. This does not work | Nobody understood the value proposition on the landing page |
195| All tildes | Indifference (arguably worse than failure) | Users did not care about the feature either way |
196 
197### Minimum Viable Signal
198 
199- **3 out of 5** participants showing the same pattern is a meaningful signal
200- **5 out of 5** is a strong signal that demands action
201- **2 out of 5** is inconclusive and may require further testing
202 
203## End-of-Sprint Debrief
204 
205### Step 1: Review Sprint Questions (15 minutes)
206 
207Return to Monday's sprint questions. For each one:
208 
2091. Read the question aloud
2102. Review the evidence from the grid
2113. Determine the answer: Yes, No, Partially, or Inconclusive
212 
213**Template:**
214 
215```
216Sprint Question: Will first-time users understand what our product does?
217Evidence: 4/5 correctly described the product on first impression. 1 was confused by the headline.
218Answer: Yes, with minor copy improvements needed.
219```
220 
221### Step 2: Categorize Findings (20 minutes)
222 
223Organize all observations into three columns on the whiteboard:
224 
225**What Worked (keep and build on):**
226- List specific screens, features, or copy that received consistent positive feedback
227- Include direct quotes from participants
228 
229**What Failed (fix or remove):**
230- List specific moments of confusion, frustration, or failure
231- Note whether the failure was universal (5/5) or partial (3/5)
232 
233**Mixed Results (investigate further):**
234- List elements with split reactions
235- Note possible explanations for the split
236 
237### Step 3: Decide Next Steps (20 minutes)
238 
239| Friday Result | Recommended Next Step |
240|--------------|----------------------|
241| Core concept validated, minor issues | Build the product. Fix the specific issues identified |
242| Core concept validated, major UX issues | Run a follow-up sprint focused on the problematic areas |
243| Two concepts tested (Rumble), one won | Build the winner. Document why the other lost |
244| Core concept failed, but insights gained | Pivot and run another sprint with a new approach |
245| Everything failed | Go back to Monday. Redefine the problem. The week saved you months |
246| Inconclusive results | Recruit 5 more users and test again, or rewrite the tasks |
247 
248## Templates
249 
250### Interview Notes Template (Per Participant)
251 
252```
253Participant: #[number] Date/Time: [date, time]
254 
255FIRST IMPRESSION
256What they said:
257Understood the product: [ ] Yes [ ] No [ ] Partially
258 
259TASK 1: [Description]
260Completed: [ ] Yes [ ] No [ ] With help
261Notable quotes:
262 
263TASK 2: [Description]
264Completed: [ ] Yes [ ] No [ ] With help
265Notable quotes:
266 
267OVERALL DEBRIEF
268Would they use this: [ ] Yes [ ] No [ ] Maybe
269Key quote:
270```
271 
272### Sprint Results Summary Template
273 
274```
275SPRINT: [Name] DATE: [Week of] TARGET: [Monday's target]
276 
277SPRINT QUESTIONS AND ANSWERS:
2781. [Question] → [Answer with evidence]
2792. [Question] → [Answer with evidence]
2803. [Question] → [Answer with evidence]
281 
282WHAT WORKED: WHAT FAILED:
283- [Finding 1] - [Finding 1]
284- [Finding 2] - [Finding 2]
285 
286NEXT STEPS:
287- [ ] [Action item 1] — Owner: [Name] — Due: [Date]
288- [ ] [Action item 2] — Owner: [Name] — Due: [Date]
289```
290 
291## Common Friday Mistakes
292 
293### The Interviewer Explains the Prototype
294 
295**Problem:** When a user gets confused, the interviewer says "Oh, this is supposed to be a dashboard where you can..."
296**Fix:** Practice the phrase "What would you expect to see here?" Let confusion happen. It is the most valuable data.
297 
298### The Team Watches Passively
299 
300**Problem:** The observation team watches interviews like a movie without taking notes.
301**Fix:** Require sticky notes. Each person should produce 5-10 notes per interview. The grid on the whiteboard makes note-taking structured and accountable.
302 
303### Skipping the Debrief
304 
305**Problem:** After the last interview, the team is exhausted and says "let's process this next week."
306**Fix:** The debrief is the most important hour of the entire sprint. Do it while observations are fresh. Waiting even one weekend degrades the team's memory and enthusiasm.
307 
308### Recruiting the Wrong Users
309 
310**Problem:** The team tests with colleagues, friends, or people who do not match the target customer.
311**Fix:** Use a screener survey. Recruit people who match the customer profile defined on Monday. Test with strangers who have no loyalty to the team.
312 
313### Over-Indexing on One Participant
314 
315**Problem:** One user gave dramatic negative feedback and the team panics.
316**Fix:** Wait for patterns. One negative reaction out of five may be an outlier. Three negative reactions out of five is a real signal.
317 

Discussion