Getting meaningful customer feedback feels harder than ever.

Let’s say you have 10,000 customers, but only 1 or 2 people mention on Reddit, Facebook, or another platform that they dislike a feature or want something changed.

How do you decide whether that feedback represents a real product problem or just a personal preference?

For example, many WordPress companies place promotional or sale banners inside the WordPress dashboard.

Some users find those notices annoying and feel the dashboard should stay clean.

But other users may actually benefit from them because they discover a discount they would otherwise have missed.

So one feature can create value for one group while frustrating another.

I’m curious how product teams handle situations like this.

Do you look mainly at:

• Number of similar complaints?
• Percentage of affected users?
• Support tickets and feature requests?
• Usage or behavioral data?
• Revenue/business impact?
• User interviews or surveys?
• How easy or risky the change is?

And how do you avoid overreacting to a few loud users while also not ignoring valuable early feedback?

Would love to hear how other product teams approach this.