Assessment Pro is a premium feature available only to Gnowbe Pro and Enterprise subscribers. If you wish to subscribe to Assessments Pro, please contact your Gnowbe representative.
What is Assessment Pro?
Assessments Pro allows a curator to design programs that another individual can review and assess (both qualitatively and quantitatively). This individual could be the learner's manager, supervisor, teacher, or an external authority on the subject/topic on which the candidate is being trained on.
Essentially, you can evaluate and score responses made by learners in a Gnowbe Program from participatory actions like:
- MCQs
- Q&A
- Take Photo or Video
- Choose a file
Please note that if you are using Assessment Pro in a program, you won't be able to add regular Assessment actions to the program.
When will I need to use Assessment Pro?
For example, if your learners have undergone a certain training, you could ask them to apply their learning by using Gnowbe's various apply actions (write a reflection, take a photo or video, upload a document), which their manager could review. This is great for measuring the effectiveness of the training and understanding if it has led to a change in behaviors. Assessments Pro can also effectively facilitate on-the-job learning.
How do I use Assessment Pro?
Before you start using Assessment Pro, you need to understand the different roles involved while setting Assessment Pro up. At the end of the article, you can see the section The assessment process to learn how these roles drive the end-user experience.
- Learner - the participant who is attempting the program and providing responses. The learner needs to be a registered user on Gnowbe and will contribute to a license.
- Sponsor (optional role) - the person who the learner asks for an endorsement. This could be a senior colleague, who can vouch for the learner's work. The sponsor does not need to be a registered user on Gnowbe.
- Evaluator - the person who provides a rating/grade or written feedback to the learner's responses. These ratings/grades will determine whether the learner passes or fails the assessment. The evaluator does not need to be a registered user on Gnowbe.
There are two parts to setting up Assessment Pro.
Part 1 - Design Your Program
This part is carried out on Gnowbe Web (web.gnowbe.com). To complete the steps below, you must ensure that you have a Creator role in your organization.
To enable Assessment Pro capability in a program:
- Access your program and go to your program settings.
- Scroll down and expand the Assessment Pro tab. Toggle on Assessment Pro.
- Expand the Assessment (Basic) tab to set the necessary passing grade.
Once this is done, you can go into the program and add actions. For all actions requiring user input, you'll see a new choice of rating mode at the bottom of the action. Set your choice of rating mode for each action type that requires user input accordingly.
- Rate participants' answers - the evaluator will see the learners' answers on their evaluation form and will be able to rate/grade them.
- View participants' answers - the evaluator will see the learners' answers on their evaluation form, but will not be able to rate/grade them.
- Hide participants' answers - the evaluator will not see the learner's response to this action on their evaluation form.
You can choose how you wish to design the program and set this mode for different actions accordingly. For example, in the early part of the program, where the emphasis is on learning, you can choose the option to 'View' or 'Hide participants' answers'. But in the later part of the program, when you want to evaluate your learners' responses, you can choose the 'Rate participants' answers' option.
Part 2 - Setting up roles
This part is carried out in Gnowbe Dashboard (dashboard.gnowbe.com). To complete the below steps, you need to be at least an admin of your organization or an agent of the group.
First, you'll need to publish and distribute the program to the appropriate group. While doing so, you'll see the option to exclude sponsors.
Toggling on Skip manual sponsorship will exclude sponsors from your assessment process and allow learners to submit their answers to evaluators directly.
Once your program has been distributed, you can:
- Start inviting users to your group.
- Set up evaluators (and sponsors) on Gnowbe Dashboard. Here's how:
-
- Access your group and click on Programs.
- Click on the program title.
- Click on Assessment Pro (Manual Review). A panel will open where you can see all your registered users. (Invited users will not show on this panel).
- You'll see an action column with a three-dot icon for each user.
- Click the three-dot icon to add your evaluator or sponsor.
- You'll be required to input a name and email to add your evaluator/sponsor. You can add more than one evaluator per user.
- Access your group and click on Programs.
-
NOTE:
- Evaluators can only be set from this panel in the dashboard by an agent or an admin.
- A sponsor can be preset from this panel for programs that include a sponsor. However, if no sponsor is set, the learner will be prompted to provide a sponsor at the time of submission.
Scoring mechanism
You can decide on the scoring mechanism for Assessment Pro when setting up Evaluators on the Dashboard.
There are two ways to determine if learners pass/fail:
- Aggregated Score
- % Successful Evaluation
- The passing grade for a program is set at 80%
- There are two Evaluators
- Consequently, scores from both Evaluators will be individually calculated, combined, and averaged.
- The learner has to achieve an overall rating of 80% to pass.
- The passing grade for a program is set at 80%
- There are three Evaluators
- One of the Evaluator has to be assigned as the tiebreaker
- Scores from the first two Evaluators will be first individually calculated to determine if the learner passes/fails.
- If both Evaluators pass the learner - the learner passes.
- If one Evaluator passes and one Evaluator fails the learner, the third Evaluator will then be required to assess the program and break the tie.
- The third Evaluator will now determine the decision of whether the learner passes/fails.
------------------------------
The assessment process
If you don't include a sponsor:
- The learner will complete the program. Once completed, they'll see an option to 'submit' the program. After submission, the learner cannot change his/her responses.
- The evaluator will immediately receive an evaluation form via email asking them to evaluate the learner's responses.
- Evaluators will score each response by giving a rating between 1 to 5. This corresponds to 20% to 100% on a percentage scale. They can also give open-ended feedback for each question and also overall feedback.
- Once the evaluator submits the evaluation, the result is calculated automatically, and the learner is notified immediately.
If you include a sponsor:
- The learner will complete the program. Once completed, they'll see an option to submit the program. After submission, the learner cannot change his/her responses.
- The learner may or may not be asked to key in a sponsor during submission (depending on whether the admin/agent has preset a sponsor).
- The sponsor will get notified via email with a request to endorse the learner.
- Once the sponsor submits the endorsement, the evaluator will then receive an evaluation form via email asking them to evaluate the learner's responses.
- Evaluators will then score each response by giving a rating between 1 to 5. This corresponds to 20% to 100% on a percentage scale. They can also give open-ended feedback for each question and also overall feedback.
- Once the evaluator submits the evaluation, the result is calculated automatically, and the learner is notified immediately.