Performance Management

Weighting and Anonymity in 360-Degree Feedback

Published on: 5 min readAuthor: Sotech Bilgi Teknolojileri

How to set manager, direct report and peer weights in 360-degree feedback, handle reverse-scored questions and protect rater anonymity. A practical guide.

A 360-degree review aims to show how an employee's competencies look not just to their manager but to the different people they work with every day. Collecting scores from several raters, however, does not automatically produce a fair result. How much each opinion counts, how questions are scored and how safe raters feel all determine whether the outcome can be trusted.

This article tackles the two most debated aspects of multi-rater feedback: weighting and anonymity. If you are new to the concept, start with our guide to 360-degree performance reviews.

Why weighting matters

Raters do not have the same information. A manager sees contribution to goals and quality of work up close. Peers observe collaboration and day-to-day communication. Direct reports are the group best placed to judge leadership, direction and the way feedback is given. Giving every view the same weight blurs these distinct perspectives.

Weighting means defining, in advance and transparently, how much each rater relationship contributes to the final score. That way the debate about whose score matters more happens before the review starts, not after the results are out.

Manager, direct report and peer relationships

  • Manager: usually carries the highest weight for results-oriented competencies.
  • Peers: a valuable counterweight for collaboration, knowledge sharing and teamwork.
  • Direct reports: the most direct way to measure leadership behaviour in managerial roles.

The right ratio depends on your organisation, industry and priorities for the period. What matters is that the ratios are justified and communicated to employees beforehand.

Setting weights per review period

Weights do not need to stay fixed forever. It makes sense to revisit them when the organisation is restructured, a leadership programme is launched or teams become flatter. In HibritİK Performance Management, manager, direct report and peer weights are defined separately for each review period. Past results keep their own rules, while you can strike a different balance for the new period.

Ask these questions when setting weights:

  1. Which behaviours do we want to emphasise this period?
  2. Which rater group observes those behaviours most often?
  3. How will weights be distributed for employees without direct reports?
  4. How and when will we explain the ratios to employees?

Example: different roles, different balance

Imagine a manufacturer reviewing its shift supervisors. They answer to their own managers but also lead large teams, so giving direct reports a meaningful share makes leadership behaviour count in the result. In the same company, a planning specialist with no direct reports is judged mainly by manager and peer views, and peer input shows how well cross-department coordination is working.

The key is that ratios follow a rule announced at the start of the period, not a person-by-person negotiation. The simpler and clearer the rule, the fewer objections you will face. If last period's results show one rater group consistently scoring very high or very low, factor that in when you set next period's weights.

Negatively worded questions and reverse scoring

A good questionnaire is not made up of positive statements only. Negatively worded items such as "interrupts others in meetings" stop raters from giving high marks on autopilot and encourage them to read each question properly. This is a widely used technique to reduce response-style bias.

On a negatively worded item, though, a high score signals weak behaviour. If those scores flow straight into the calculation, the result is distorted. In HibritİK you can flag a question as negatively worded and its score is reversed in the calculation, so every item points in the same direction without any manual correction.

Practical tip: include at least one negatively worded item per competency to spot forms filled in mechanically, but do not overdo it; too many negative statements tire raters.

Anonymity: the precondition for honest feedback

Peers and direct reports in particular will hold back if they fear their scores will be traced back to them, which defeats the purpose of a 360-degree review. In HibritİK rater names can be hidden: the person being reviewed sees the results but not who gave which score.

Practices that strengthen anonymity

  • In small teams with a single peer rater, remember that identity may be easy to guess.
  • Remind raters to avoid identifying details in open-ended comments.
  • Announce in writing, at the start, who will see the results and at what level of detail.
  • Do not neglect your privacy notice obligations under KVKK, Türkiye's personal data protection law.

Competencies asked only of managers

Not every competency is relevant to every employee. Asking an individual contributor about "developing the team" or "delegation" produces meaningless scores and lengthens the form. In HibritİK you can restrict a competency so it is only evaluated for managers, letting managers and specialists be assessed with suitable forms in the same period.

If you also want employees to reflect on their own performance, set this up separately as a survey or job analysis question set and discuss the answers together in the review conversation.

Setup checklist

  1. Set manager, direct report and peer weights according to the period's priorities.
  2. Review the weight and behavioural questions for each competency.
  3. Flag negatively worded questions and keep their number balanced.
  4. Restrict leadership competencies to managers.
  5. Decide whether rater names will be hidden and announce it.
  6. Check the review relationships: who rates whom.

Common mistakes

  • Changing weights after the review has finished.
  • Writing only positive statements and ignoring response-style bias.
  • Promising anonymity, then sharing results in a way that reveals identities.
  • Asking every employee about leadership competencies.

Running 360-degree reviews with HibritİK

Per-period weights, reverse scoring, hideable rater names and manager-only competencies are built into HibritİK's 360-degree evaluation feature. Reviews can be completed on the web or in the mobile apps, and results combine with mission and target scores in success reports. Start your 14-day free trial to try your own setup, or see the plans on our pricing page.

Related posts