Analyzing User Feedback

# Analyzing User Feedback - All Guest Insights

*56 guests, 64 mentions*

---

## Alexander Embiricos
*Alexander Embiricos*

> "A few of us are constantly on Reddit. There's praise up there and there's a lot of complaints... Reddit is a little more negative but real actually. So I've started increasingly paying attention to how people are talking about using Codex on Reddit actually... you get good signal on what matters and what other people think."

**Insight:** Unfiltered community platforms like Reddit provide higher-signal feedback on product flaws and 'real' user sentiment than more polished social platforms.

**Tactical advice:**
- Monitor niche subreddits for unfiltered product complaints and bug reports
- Use Reddit's upvoting mechanics to prioritize which user pain points to address first

*Timestamp: 00:56:44*


## Aishwarya Naresh Reganti + Kiriti Badam
*Aishwarya Naresh Reganti + Kiriti Badam*

> "You cannot practically sit and evaluate all the traces. You need some indication to understand what are the things that I should look at. And this is where production monitoring helps. And once you get this kind of traces, you need to examine what are the failure patterns that you're seeing in these different types of interactions."

**Insight:** Production monitoring should be used to filter and identify specific traces for manual error analysis and failure pattern identification.

**Tactical advice:**
- Use production monitoring to flag problematic traces for deeper review.
- Identify recurring failure patterns in user interactions to inform the creation of new evaluation datasets.

*Timestamp: 00:35:35*


## Anneka Gupta
*Anneka Gupta*

> "One way that we're using AI today is summarizing our user research calls. ... it'll find you the call, it'll find you the context, it'll find you the transcript and summarize exactly what we've learned from that call."

**Insight:** AI-driven summarization and tagging of user research calls allow for searchable, high-fidelity insights across the entire organization.

**Tactical advice:**
- Use tools like Dovetail to automate the transcription and summarization of customer discovery calls.

*Timestamp: 01:00:08*


## Barbra Gago
*Barbra Gago*

> "We did case studies throughout the process. We got feedback on logos. We got feedback on brand and designs, and there were plenty of people who were like, 'Oh, I like RealtimeBoard. It's straightforward.' They loved their product, but ultimately, we kept many of them informed and we really involved them in the process to the degree of not slowing us down but still getting feedback."

**Insight:** Involving core advocates in a rebranding process helps maintain loyalty while providing critical feedback on new visual directions.

**Tactical advice:**
- Run case studies and feedback sessions on new logos and designs with existing users
- Keep early advocates informed of major changes to maintain their sense of ownership

*Timestamp: 33:31*


## Bob Moesta
*Bob Moesta*

> "And then what we do is instead of trying to look for themes across all of them, we actually do something, instead of segmenting them, we cluster them, we find the pathways because what you start to realize is it's not one reason why people do it, it's sets of reasons."

**Insight:** User feedback should be clustered into behavioral 'pathways' rather than demographic segments.

**Tactical advice:**
- Identify the 'hire and fire' criteria for different clusters of users.
- Look for conflicts where one user group wants speed while another wants thoroughness.

*Timestamp: 00:20:29*


## Brian Balfour
*Brian Balfour*

> "The first product we launched is called Reforge Insights, which acts like your AI product researcher, aggregates all the feedback from all the sources, uses AI to analyze it, helps you explore it, but also will start to identify what are the gaps, the things that you don't have in your feedback today and auto-generate the research to go gather all those new insights