I’m a mixed-reality product designer, and I keep coming back to one small interface decision: when an avatar’s gaze, expression, or hand gesture is inferred with low confidence, should anyone be told?
The usual alternative is invisible smoothing. That can reduce jitter, but it can also make someone look more attentive, dismissive, cheerful, or emotionally certain than the sensor data supports. In a meeting or classroom, apparent eye contact is social information. In an accessibility-focused setting, silently “fixing” an unusual movement may turn a person’s actual communication into a more conventional performance.
I’m considering a subtle, user-controlled cue—a faint halo, desaturation, or indicator that says “this is estimated,” not “your body is malfunctioning.” But would that improve understanding and consent, or just add noise and make imperfect bodies feel like technical failures? Should uncertainty be visible to everyone, only the user, or nobody?