HR Program Evaluation Template – 360° Feedback

Business Problem to be solved:

  • Feedback and increased communications will result in better management practices and reduced conflict which will increase productivity and reduce turnover.
  • Improved teamwork will result in increased productivity.

The Theory:

Increased feedback and multi-source feedback results in a change in management behavior and an increase in performance. Theoretically, anonymous feedback is more open and honest then one-on-one feedback. The assumption is that honest feedback changes management behavior faster than restricted feedback.

It is also assumed that employees (and customers) that are “listened to” and involved will produce more and have higher satisfaction and retention rates.

A basic assumption is that employees have knowledge of management behaviors that can be provided to management. A further assumption is that the “anonymity” provided in the 360 processes is credible and results in honest feedback.

Possible Program Goals:

  1. Get managers to understand how others perceive them.
  2. Involve workers in developing their own manager.
  3. Opening more lines of communications (including customers and employees in a formerly top-down process).
  4. A management competency development tool.
  5. A management evaluation/assessment tool.
  6. A promotion/layoff qualification tool.

Department Where Program is Usually Based:

  • OD
  • Compensation
  • EE (EE = Employee) Relations

Possible Advantages / Benefits of the Program:

  1. Provides multi-data points/opinions which may reduce Perf App. errors and biases.
  2. Employee’s (EE’s) feel that their opinions count.
  3. Increases EE and possibly customer involvement.
  4. Increases EE ownership of their managers’ development.
  5. Increases management responsiveness to EE concerns.
  6. Allows honest feedback (when it is anonymous).
  7. Has multiple uses? RIF, Promotion, Assessment of skills, individual development, etc.
  8. Increases overall communications.
  9. It increases self-awareness of what others think of us.
  10. It can include external customers in the feedback process.
  11. Encourages productivity improvement through increased communications (Individual & Team).
  12. It provides more open communication at the upper levels of management where open criticism is more difficult.
  13. Replaces occasional “war” story performance appraisals with periodic sampling and data.
  14. Relatively cheap compared to the costs of bad performance and bad management.
  15. It is analyzed with statistical tools that can eliminate “outlying data” and allow for trend analysis.
  16. Its statistical record provides good documentation for possible legal actions.
  17. It has more “face’ validity than traditional performance appraisal techniques.
  18. Its visibility increases the discussion about the need for better performance appraisals
  19. Giving the results to both EE’s and top managers lets the EE’s know that top management is aware of their concerns.
  20. Feedback discussion sessions result in increased time spent on Performance Appraisals.
  21. It’s a good first step in opening the lines of communication.
  22. Most of it can be done “remotely” (without face to face meetings) when necessary.
  23. It may result in a higher “success rate” in the promotions of managers.
  24. Sales and profit may improve because customers’ concerns are placed on the table for all to see.
  25. Because it is often administered by consultants “outside’ advice is available to identify and resolve performance problems.
  26. Baseline data makes cross-departmental and multi-year comparisons more accurate
  27. At least initially it’s “fun” to do and it increases EE excitement because they are being listened to.

Possible Disadvantages / Concerns of the Program:

  1. There is no data it actually improves productivity, increases retention, decreases grievances or that it is superior to forced ranking and standard Perf. App. systems. It sounds good but there is no proof it works other than a lot of companies have tried it.
  2. It serves as a poor substitute for unassisted 1 on 1 communication and can short circuit natural feedback channels.
  3. The need to use it shows how poorly normal communications channels are working. 360 use discourages efforts to “fix” these essential systems.
  4. It, like all traditional Perf. App. systems, focus on historical events while businesses must focus on future events. In a rapidly changing world, the past may not be the best model to learn from.
  5. There is no evidence of a correlation between high 360 scores and high performance.
  6. It is time-consuming (when done periodically) and managers and EE’s learn to hate the time commitment.
  7. Little evidence that managers actually listen to EE’s opinions. This can actually decrease productivity due to frustration when the EE’s realize they have been deceived into thinking their opinions matter.
  8. It’s subjective, not objective. It is based on opinions, not behaviors. Popularity is not performance. Opinions are not business results.
  9. Opinions serve as a poor substitute for real performance data.
  10. Most EE’s don’t see the big picture so their feedback is based on minutia and gives no real insight into strategic issues.
  11. Anonymous processes short circuit the need to develop 1 on 1 communication skills and the ability to provide negative feedback.
  12. It is a slow and time-consuming process. Respondents are slow to fill out the forms and a skewed response occurs when only the unhappy respond. Anonymity does not allow for encouraging individual non-respondents to participate, resulting in a low response rate.
  13. Questions often relate to attitudes and soft skills which are not easily assessed or observed by the average EE.
  14. Managers / EE’s despise doing additional Perf. App. of any kind.
  15. The ROI can be a negative number.
  16. Outsourcing the analysis of the results (because it increases EE confidence in 360 anonymity) often slows the reporting of the results and makes it expensive (some aver. $200 per manager). It allows sensitive company data to be seen by consultants who may compromise it.
  17. The process is not “owned’ by the managers and they thus learn to treat it as another HR program of the month. It’s just another fad.
  18. It will not work without top management support and participation.
  19. Evaluators do not have copies of the managers’ job descriptions or performance goals against which to assess their performance.
  20. Managers’ rewards are often not tied to getting excellent 360 assessments.
  21. Subjective opinions of managers are influenced by outside factors (general satisfaction, pay increases, etc.) which cause results to vary, even though management behavior hasn’t.
  22. Opinions are not tied to the performance of the individual giving the assessment. This may result in an “averaging” of the opinions of high performers (or large customers) with those of low performers and thus skew the results.
  23. Anonymity allows forgetting, even “pot shots”, and worker “secret collaboration” on assessments to “get” a tough manager. It discourages managers who are change agents and “punishes them” for their aggressiveness with feedback resulting from resistance to change. Also, anonymity does not automatically result in unbiased opinions.
  24. Unions resist it and often claim it is a tool to fool/distract the workers from their unhappiness
  25. It makes top management “lazy” because they often stop “managing by walking around.”
  26. Managers are often not trained on how to interpret and use the 360 feedback. Managers are not trained in how to change and not all managers can change whether they get feedback of not.
  27. Many 360 systems survey everyone rather than relying on statistical sampling techniques.
  28. Managers feel they are often evaluated by people who have never seen them in action (or seen them at all) or do not understand the nature of management work.
  29. If forces managers into making popular decisions rather then tough ones.
  30. Perf. App never works whether there is data or not. Managers are promoted on results and/or politics. Workers’ opinions and 360 will not change that.
  31. It’s base on an unproven theory that increased feedback results in increased performance.
  32. It wastes managers’ time by requiring them to go to 360 feedback training which they dislike.
  33. It asks for problems but it doesn’t ask for solutions or show how to solve the problems.
  34. No proof that managers with good Perf. App. are more productive than those with bad Perf. App.
  35. Often misused as a RIF, promotion or disciplinary tool.
  36. Customers can be frustrated when they must waste their time filling out forms, especially when actual performance rarely changes.
  37. Nothing actually happens after 360. There are no forced rankings and no one is ever fired or demoted as a result. Eventually, this results in the program being dropped.
  38. 360 questions are not usually customized to departmental or company needs.
  39. EE’s are suspicious that 360’s are really anonymous and thus are not really honest in their assessments. EE’s assume managers will “see them” in the comments and retaliate against them.
  40. There is no reward (punishment) for EE participation and spending the time to give honest feedback.
  41. EE’s are not trained in how to give honest and accurate feedback.
  42. Once a year, feedback is not sufficient in a rapidly changing world. A form is a poor substitute for a face to face meeting where trust can be built
  43. Employees in a rush can “Christmas tree” the form and skew the results.
  44. Results are skewed by recent events and are not reflective of performance over the entire period.
  45. Most 360 programs are dropped as budgets get tight or as managers tire of the time it takes.
  46. It doesn’t let the manager “self-monitor” their own performance so they can continually improve.
  47. Not all managers have enough EE’s to make the feedback statistically significant and reasonably anonymous.
  48. Picking who to survey is subjective and is difficult in a team environment when teams don’t stay intact for long.
  49. In an international environment, meeting for feedback sessions is too expensive. Cross-cultural/language interpretations are difficult to put into a questionnaire.
  50. Questions seldom correlate directly with the required core competencies and thus can confuse managers by sending mixed signals. 360 scores often conflict with other assessment and reward systems.
  51. It only makes a difference in “sick” organizations. Well managed companies get better feedback, faster and cheaper using other tools.
  52. It’s run by psychologists.

Critical Success Factors / Characteristics of a World-Class Program:

  1. It has a direct, measurable impact on productivity and shareholder value.
  2. Anonymity maintained.
  3. Integrated with other systems.
  4. Owned by EE’s and management.
  5. Its costs are billed to the managers using it.
  6. Tailored to company needs and flexible for changing needs.
  7. Focuses on core competencies.
  8. Managers and evaluators are trained in how to use it.
  9. Focuses on improvement and the future rather than blame and the past.
  10. It is tied to rewards.
  11. Allows responses to be analyzed by their “source code” (not the individual).
  12. Has a set of targeted goals.
  13. Has JIT and worldwide capabilities.
  14. It can be adapted to the team environment.
  15. Its success is continually monitored and improved.

Examples of firms that are considering/have tried it:

  • HP
  • DFS inc.
  • Levi
  • Chrysler
  • Motorola
  • Merck
  • Failure Analysis Inc
  • Intel
  • Oracle
  • And many others

Program Costs/ Development Time Estimates:

  • Expect a broad range of costs ($50 – $1000 per manager) depending on the amount of consulting help and # or respondents selected for each manager.
  • Development time is long (expect at least 6 months) unless off the shelf vendors are used.

Measures of Program Success:

  • Increase in productivity in divisions using 360 vs. those who don’t (also this year vs. last).
  • Higher EE and customer retention rates.
  • Increased promotion and reward rates for managers with “high” 360 scores and vice versa.
  • High ROI on 360 programs (Benefits less costs).
  • Manager / EE / Customer satisfaction with the 360 process.

Miscellaneous Notes:

  • Possible consulting help includes PDI, Inc., and Feedback Plus

As seen on Gately Consulting

About Dr John Sullivan

Dr John Sullivan is an internationally known HR thought-leader from the Silicon Valley who specializes in providing bold and high business impact; strategic Talent Management solutions to large corporations.

Check Also

Everyone Jokes About HR… These Fast-Acting Strategic Steps Will Change That

There are 20.5 million “jokes about HR,” double those in accounting and millions more than …