A performance review happens once or twice a year. The informal judgment of your colleagues is running continuously, and it is usually the one that actually decides how you are treated.
What the research says
Organizational research on workplace gossip is consistent that it is not simply idle talk, it functions as a real accountability system, people moderate their behavior because they know others are watching and will talk if they step out of line. Robin Dunbar's broader thesis on gossip frames it as the mechanism humans evolved to track reputation once groups grew too large to observe everyone's conduct directly. The formal court, HR, a performance review, an official complaint, is the exception. The informal one is the default, and it is always in session.
Why the formal process is not where this gets settled
A single officially documented incident matters less than the accumulated, informal read your peers have already reached before any formal process ever starts. By the time something reaches a formal proceeding, the informal verdict is usually already in, and the formal process mostly ratifies it rather than discovering it fresh.
Where to start
Do not wait for a formal moment, a review, a complaint, a decision meeting, to address a reputation problem. The informal court reaches its verdict earlier and moves on. If something is being misread about you day to day, the corridor conversations and casual reactions are where that gets corrected, not the annual review six months later.
That means the fix, when something needs fixing, is also informal, a clarifying comment in the moment, a pattern you visibly change, not a defense prepared for a meeting that has not happened yet.
Reading whether something is actually being misread, versus a fair read you would rather it were not, is a judgment worth being honest with yourself about first. What this gives you is where to actually address it once you have made that call.
There is a specific way to correct a misreading day to day without it looking like you are campaigning for your own reputation, and it is worth having in mind before the next casual moment where it would help.