Using Claude to Analyze a Lyssna Usability Study

🧪 My usability test recruiting defaulted to “global.” I didn’t notice. Eep! Claude did though. 👀

I tested my redesign against the original in Lyssna, then used Claude to help analyze the results. It flagged participants outside the US. I checked my settings, and sure enough… global recruiting. So I recruited 5 more US participants.

Here’s what else Claude helped with:

→ Organized the responses, identified the 10 US participants, and flagged screener failures.

→ Scored answers against my answer key: right, wrong, or unsure.

→ Matched tap coordinates to my screens. I checked those against the click maps.

→ Found patterns in written answers, including 2 people asking "why" questions

→ Helped me check whether findings changed when looking at different participant groups.

→ Flagged where my redesign did worse and revised an earlier interpretation after we corrected the dataset.

My takeaway: check your recruiting settings aaand check the AI’s analysis, too. 🔎

🧐CURIOUS: How are you using AI in your research? Any prompts or approaches you’ve found especially useful?

#UXResearch #ProductDesign #AI

Next
Next

First Impressions of Lyssna