Back

Create on demand 360 multi-rater assessments

This guide will focus primarily on the project setup for on demand 360 multi-rater assessments. A 360 multi-rater assessment is a process for gathering feedback about an employee from multiple perspectives of their organization. This feedback offers a well-rounded view of this individual's strengths and areas for improvement which can be used to create an effective learning and development plan.

BEST PRACTICE

Before consulting this document, it is recommended to know the fundamentals of setting up a standard 360 multi-rater assessment project. To learn more, see Create 360 multi-rater assessments.

In this guide, we have created a special scenario that is different from the standard 360 multi-rater assessment. Unlike the standard 360 review, on demand 360 reviews invite employees to set up their own 360 multi-rater assessments on a recurring basis. Each employee will have the option to participate in their 360 assessment and will be able to select the people evaluating them. If the employee decides to participate and launch their assessment, they may be able to adjust the schedule, select questions, monitor response rates in real-time, and download the results. Once the assessment has ended, the feedback will be analyzed in reports shared with employees, managers, department heads, and the CEO/President.

What we are building

A 360 multi-rater assessment that allows each employee to opt out to having themselves reviewed by people selected in the organization.

Our choices

The following parameters will be applied throughout this guide:

  • Rater selection - Employees can select their peers, direct reports (if any), and optionally add other people outside of the organization, such as clients, to participate in their assessment. The employee and their manager will be preselected in the assessment.
  • Quarterly assessment period - The assessment period will be quarterly (every 3 months), where the employee will decide whether they want to run a 360 review.
  • One project required - Only one project is required to fully automate the process of running on demand 360 reviews with the least amount of maintenance.
  • Employees choose to participate - Each employee can opt out to have themselves assessed for the review period. If they take no action, their assessments will automatically launch.
  • Unsolicited feedback - Employees can opt in to review other employees in the organization. This will be classified as unsolicited feedback.
  • Multi-level questionnaire - The questionnaire will be categorized into four sections: core company questions, department questions, leadership questions, and questions selected by the employee. Core company questions will be common for all reviews, while department, leadership, and employee selected questions will be specific to the employee under review.
  • Delegated timing - Employees can adjust the timing of their assessment.
  • Instant results - Employees can download anonymous responses the moment their assessment ends, in addition to reports.
  • Distributed reports - Individual reports are shared with the employees while aggregate reports are shared with managers, department heads, and the CEO/President.
Do the assessment periods have to be in quarters?
Could we instead create multiple standard 360 review projects instead of one on demand 360 project to achieve the same result?
Can employees be opted out by default instead of opted in for their 360 review?

What is needed for setting up this type of evaluation project:

CriteriaValuesDescription
Definition typePrimary/secondary subject pairingThis allows employees to be evaluated for multiple periods within a single project.
Groups and privilegesSelf (RS, QP, SM, FO, RV)
Managers (FO, RV)
Peers (FO)
Direct Reports (FO)
Others (FO)
Unsolicited (FO)
Department Heads(RV)
CEO/President (RV)
Employees will be asked to select the raters who will evaluate them (RS), personalize the questionnaire (QP), manage the evaluation (SM), fill out the questionnaire (FO), and view reports (RV).
Managers will be asked to fill out the questionnaire (FO) and view reports (RV).
Peers, Direct Reports, Others, and Unsolicited will be asked to fill out the questionnaire (FO).
Department Heads and the CEO/President will be granted access to view reports (RV).

General overview of steps

Overveiw of general steps

  1. Add datasources - Include the data for the assessment periods, the employees providing feedback, and their relationships to each other.
  2. Create the Definition - Select what type of evaluation structure to use.
  3. Define groups and privileges - Create the groups that will participate in the assessment and assign privileges to them.
  4. Create the project - Select the project's Definition, audience type , confidentiality level, and automatic update option for groups.
  5. Verify subjects and members - Check to see that the right subjects and group members have been automatically included in the project.
  6. Build the questionnaire - Create and configure the core company questions to your specifications, and allow employees to select from a list of validated questions.
  7. Configure tasks - Apply initial task settings.
  8. Schedule tasks - Set the schedule to collect the feedback.
  9. Publish project - Set an overall schedule for the feedback process and publish the project.
  10. Create reports - Analyze the feedback in reports to provide a summary and record of the review.

Step 1 - Add datasources

The first step is to add datasources containing relevant information on the quarterly assessment periods and employees that will be involved in the feedback process.

What you need for datasources:

Datasource nameDatasource typeContentsSample CSV file
QuartersObjectQuarterly assessment periodsQuarters.csv
EmployeesUserEmployeesEmployees.csv
Quarters-EmployeesRelationshipHow employees are linked to the quarterly assessment periodsQuarters-Employees.csv
Manual-EntryUser (manual entry)Supports the ability to manually enter people that are not part of the same organization (clients, suppliers, etc.) for the purpose of rater selection360-ManualEntry.csv
Org-HierarchyHierarchyHow the organizational hierarchy is structured and links to employeesOrg-Hierarchy.csv
Org-Hierarchy-UsersRelationshipHow employees are linked to their respective organizational rolesOrg-Hierarchy-Users.csv

Step 2 - Create the Definition

The next step after adding datasources is to create the Definition.

What you need for the Definition:

Definition settingsValues
Definition typePrimary/secondary subject pairing
Subject source360° feedback
Secondary sourceEmployees
Pairing sourceQuarters-employees
Create the on demand 360 definition
Why should I use the primary/secondary subject pairing Definition type for an on demand 360 project?

Step 3 - Define groups and privileges

As part of the Definition, you will also need to create the groups of individuals that will be participating in your 360 assessments and assign them privileges.

NOTE

You may also apply a data filter as part of the Definition to select specific employees if not all departments wish to participate in offering on demand 360 evaluations.

NOTE

It may be useful to understand what the fields in your employee (user) datasource represent before defining groups and privileges for your 360 on demand project. For example, the Reports_To column represents which person an employee reports to, so we will be using that field to create the managers group.

Managers group datasource file

What you need for groups and privileges:

NameMin #Max #Link typePrivilegesDescription
Self1N/ALinks toRater selection (RS) Question personalization (QP) Fillout (FO) Report viewing (RV) Subject management (SM)The employee that can rate themselves and judge their own aptitude.
ManagersN/AN/ALinks toFillout (FO) Report viewing (RV)The employee's manager that is automatically set based on the employee (user) datasource.
Peers38Manual selectionFillout (FO)Employees that work alongside the individual.
Direct Reports38Manual selectionFillout (FO)NOTE: Since not all employees manage people, not all individuals will have direct reports.
Others38Manual entryFillout (FO)People that interact with the employee but are not part of the same organization (clients, suppliers, etc.).
UnsolicitedN/AN/AManual selectionFillout (FO)Employees who volunteer to give additional feedback
Department HeadsN/AN/AOrganizationReport viewing (RV)Employees that lead each department in the organization.
CEO/PresidentN/AN/AOrganizationReport viewing (RV)The chief executive officer of the organization.
NOTE

The organization link type will not be listed until you have created organizational links. For more information, see Dynamic Role Access (DRA) power guide.

NOTE

At the moment, the Hierarchy link type is only supported for the single subject traditional project setup.

Create self group for on demand 360 assessment
Create managers group for on demand 360 assessment
Create peers group for on demand 360 assessment
Create direct reports group for on demand 360 assessment
Create others group for on demand 360 assessment
Create unsolicited group for on demand 360 assessment
Create department heads and ceo/president groups for on demand 360 assessment

Step 4 - Create the project

The next step after defining groups is to create the feedback project.

What you need for creating the project:

Project settingsValues
Definition selected360 on demand definition created in Step 2
Automatic updateEnabled for self, managers, and subjects (quarterly assessment periods)
Project audiencePrivate
ConfidentialityYes (recommended)
Project name360 on demand
Remove subjects and raters that have been deletedEnabled
Create the 360 on demand project
IMPORTANT

Since Automatic Update was enabled for all subjects and groups when creating the project, Blue will automatically populate subjects and group members in the project.

Although this process is automated, it is crucial that you verify the right subjects and group members have been included in the project.

Get started by navigating to the MEMBERS - EXPORT/IMPORT tab and select export members to download a CSV file of all subjects and associated group members in your project. For more information, see Export or import project members.

Example of exported data (quarterly assessment periods and their paired group members):

SubjectIDSubjectNameGroupCaptionMemberIDMemberName
2022-Q1360 - Q1, 2022SelfaabadeArtie Abade
2022-Q1360 - Q1, 2022PeersjschaferJohna Schafer
2022-Q1360 - Q1, 2022ManagerstcleghornTymon Cleghorn
2022-Q2360 - Q2, 2022SelftipwellThorpe Ipwell
2022-Q2360 - Q2, 2022Direct ReportsestrankEstella Strank
2022-Q2360 - Q2, 2022UnsolicitedblillyBobette Lilly
2022-Q3360 - Q3, 2022SelfjscottJames Scott
2022-Q3360 - Q3, 2022OthersnbrackNora Brack
2022-Q3360 - Q3, 2022PeersrjugginsRoxie Juggins
NOTE

If you did not enable Automatic Update for groups and subjects, see Select members in a subject pairing project for steps on how to manually add group members to the project.

Step 6 - Build the questionnaire

The next step after creating the project is to build the multi-level questionnaire. The questionnaire will be categorized into four sections: core company questions, department questions, leadership questions, and questions selected by the employee. To learn more, see Build and manage a questionnaire.

What you need to know about building the questionnaire:

SectionsQuestion Type(s)Description
Core company questionsSingle selection table Section titleA list of preselected, centrally administered questions common to all 360 multi-rater assessments.
Department questionsSingle selection table Section titleDepartmental triggers^1
Leadership questionsSingle selection table Section titleQuestions that assess the employee's managerial/leadership skills specific to their team in the department.
Personalized questionsSingle selection (selectable) QP section levelEmployees can select from a list of validated questions.
NOTE

To learn more about personalized questions, see Create personalized questions.

NOTE

Example of employees (user) datasource:

Example of employees (user) datasource

Example of departmental triggers:

Example of departmental triggers

Example of setting up a 360 on demand questionnaire:

Example of setting up a 360 on demand questionnaire

Step 7 - Configure tasks

The next step is to configure the tasks associated with each privilege so that those tasks can be performed by the different groups.

What you will need to configure tasks:

Task typeTask owner(s)ConfigurationSelected option
Rater selection (RS)SelfAllow modifications after submitting
Allow raters to be members of multiple groups
Require authentication
Enabled
Enabled
Enabled
Subject management (SM)SelfAllow task owner to set subject participation
Default participation
Allow task owner to set evaluation scheduling
Allow task owner to set start date
Require authentication
Impact of task owner removal
Enabled
Opt-in
Enabled
Enabled
Enabled
Delete task
Question personalization (QP)SelfAllow modifications after submitting
Show all questions in question personalization view
Allow task owner to copy questions from a previous project
Allow task owner to copy questions from a previous project
Set min and max for optional and customizable questions quota
Require authentication
Impact of task owner removal
Enabled
Enabled
Enabled
Min: 0
Max: 5
Enabled
Delete task
Fillout (FO)Self
Managers
Peers
Direct Reports
Others
Unsolicited
Include welcome page
Include task list ono thank you page
Enable certificates
Enable self-enrollment
Allow user to opt out from the task list and questionnaire
Impact of task owner removal
Enabled
Enabled
Enabled
Enabled
Enabled
Enabled
Delete task
BEST PRACTICE
  • Require authentication - It is recommended to enable this option for all task types especially if participants in your organization use SSO.
  • Impact of task owner removal - It is generally recommended to enable 'Delete task' for all task type. This will automate the replacement or removal of users automatically synched with your HRIS, such as managers.
Why should I delete/stop task for impact of task owner removal?
Why should I set a min and max questions quota for the question personalization task?
Why would I allow the rater selection and question personalization tasks to be modifiable after submitting?

Get started by navigating to the TASKS tab and enabling the rater selection, subject management, question personalization, and fillout tasks. For each task, select configure to configure its settings.

Select and configure project tasks

Configure the rater selection task
Configure the subject management task
Configure the question personalization task
Configure the fillout task
How would I know which assessment periods to make available for self-enrollment?

Step 8 - Schedule tasks

After you have configured the tasks, the next step is to schedule when each task starts and ends.

You may use the following schedule as a guideline:

Task typeStart dateEnd dateReminders
Rater selection (RS)
Subject management (SM)
Question personalization (QP)
14 days before assessment start date105 days after start date1-2
Fillout (FO)Assessment start date90 days after start date1-2

Notification schedule

NOTE

For steps on how to schedule tasks in your 360 project, see Configure project task schedules.

Step 9 - Publish project

The next step is to publish the project, which is essentially activating the tasks so that they can be completed by all the groups.

What you will need to publish the project:

Publishing settingSelected option
Verify that subjects and members are addedExport members shown in Step 5.
Project start dateBefore RS, SM, and QP tasks begin
Project end dateAfter RS, SM, and QP tasks end
IMPORTANT STEPS BEFORE PUBLISHING

Before publishing the project, verify that subjects and members have been automatically populated to the project if not already done in Step 5.

After verifying that the appropriate subjects and members have been added, navigate to the PUBLISH tab to start publishing the project. For more information, see Publish a project.

Step 10 - Create reports

The final step is to create reports which analyzes the employee feedback collected from the project. For 360 on demand assessments, individual reports will be shared with employees, and aggregate reports will be shared with managers, department heads, and the CEO/President. For steps on how to create reports, see Create a new report

PROPOSED REPORTS

It is recommended to create the following reports:

  • Employee report - This one is one per quarter leveraging the individual breakdown by secondary subject report.
  • Employee report (cumulative) - This one is an aggregate of the employee based on Group By secondary subject.
  • Department report - Aggregate based on Group By secondary subject department.
  • Company report - Aggregate based on Group By secondary subject Company.

What you will need for individual reports:

Report settingValue(s)
Project type selectedOn demand 360 project
Report typeIndividual
DistributedEnabled
Breakdown by secondary subjectEnabled
Automatic updateEnabled
Types of report blocks usedResponse table
Johari window
Spreadsheet
Score

Example of published individual employee report:

Example of published individual employee report

What you will need for aggregate reports:

Report settingValue(s)
Project type selectedOn demand 360 project
Report typeGroup by
DistributedEnabled
Breakdown by secondary subjectEnabled
Automatic updateEnabled
Types of report blocks usedResponse table
Johari window
Spreadsheet
Score
Summary

Example of published departmental group by report:

Example of published departmental group by reportBold

KNOWN ISSUES FOR ON DEMAND 360 REVIEWS

Login for external groups - Manual Entry groups (for external raters, such as clients) cannot log in, therefore it is currently not recommended to use Require Authentication for the fillout task. If authentication is required for employees (e.g., to activate self-enrollment), consider collecting feedback from external participants in a separate project that does not require authentication.

Back to top

Copyright © 2025

Explorance Inc. All rights reserved.