Purpose Statement

The Evaluation Type Configuration process establishes the foundational settings for an evaluation within the Evaluations module. Creating an Evaluation Type allows agencies to define evaluation requirements, scoring methods, evaluator assignments, signatures, standards, and other settings that will be used throughout the evaluation process.

Proper configuration ensures evaluations are organized, standardized, and aligned with departmental training and certification requirements.

Background Information

Evaluation Types serve as reusable templates within the Evaluation Library. Each Evaluation Type defines:

• Evaluation metadata and categorization
• Evaluation duration requirements
• Signature requirements
• Evaluator assignments
• Associated standards and compliance references
• Evaluation behavior settings

Before creating Evaluation Types, administrators should ensure Evaluation Categories, Groups, Subgroups, Authorities Having Jurisdiction (AHJ), and any required standards have already been configured.

Required Permissions

Users should have permissions that allow them to:

• Access the Evaluations module
• Access the Evaluation Library
• Create Evaluation Types
• Edit Evaluation Configuration Settings
• Manage Evaluator Assignments
• Associate Standards and Authority Codes

Video

Updated Video Coming Soon!

Step-by-Step Guide

1. Navigate to the Evaluation Library

• Open the Evaluations module.
• Select Evaluation Library.
• Click Create Evaluation Type.

The Evaluation Type Configuration page will open.

Enter Configuration Information

1. Name (required)
2. Evaluation Duration
3. Category (required)
4. Associated Group (required) 
5. Sub-group - if necessary
6. Configure Short Code
   • The Short Code will auto generate by default but by toggling the option to "off" users can create their own code.

1. Enter information about Critical Fails - this is an information only field used to cue evaluators into what constitutes a Critical Fail when evaluating another user
2. Add in associated standards - this information is pulled from the Training Module
3. Evaluation Description (required)
4. Add in an attachments

1. Add in any Authority (AHJ) or associated codes for this evaluation type
2. Checklist Settings
   • Enable Rubric Scoring (optional) - in place of standard answer types enabling rubric scoring makes the checklist scoring a 1-5 scale. 
   • Evaluation Timer - enables a countdown clock that will appear once an evaluation has begun
   • Enable Spot Evaluation - Allows evaluators to start an evaluation without formal scheduling

• Configure Signature Options
  1. Evaluator signature is always required and by default, the logged in user will automatically be the evaluator signature 
  2. Require Candidate Signature 
  3. Manage Additional Signature 
     • Up to two additional signature can be included and are typically used for Training Admins that may need to sign off as well
  4. Manage Assigned Evaluators

Configure Additional Signatures

Additional signatures can be required for review and approval.

To add a signature:

1. Select Add Signature.
2. Enter a Signature Label.
3. Define who may sign.

Examples include:

• Field Training Officer
• Training Chief
• Battalion Chief
• Captain
• Senior Firefighter
• Medical Director

Configure Evaluators

The Assigned Evaluators section controls who can access and perform evaluations.

To restrict evaluator access:

• Open Assigned Evaluators.
• Select the appropriate personnel group(s).
• Save the assignment.

If no evaluators are assigned:

• Any user may be able to initiate the evaluation.
• Certain evaluator functions may still be restricted based on permissions and signature requirements.

Save the Evaluation Type

After all configuration settings have been completed:

• Select Save.
• Confirm the Evaluation Type has been successfully created.

Best Practices

• Use descriptive evaluation names that clearly identify the skill or competency being assessed.
• Maintain consistent naming conventions across all Evaluation Types.
• Attach supporting documentation whenever certification or compliance standards apply.
• Use Categories, Groups, and Subgroups consistently to improve organization and reporting.
• Restrict evaluator access when evaluations should only be administered by designated personnel.
• Configure signature requirements carefully to match departmental approval workflows.
• Review passing percentages to ensure they align with departmental standards.

Avoid:

• Using vague evaluation descriptions.
• Leaving evaluator assignments unrestricted when oversight is required.
• Confusing Critical Fails with checklist-based fail conditions.
• Forgetting to save configuration changes before moving to the next setup section.

Troubleshooting & FAQs

Why can't I find the correct Group or Subgroup?

Groups and Subgroups are configured during Evaluation Setup. Verify the Category configuration or update the Group/Subgroup structure in Evaluation Setup.

Why aren't my standards available for selection?

Standards must first be configured within the Training Module before they can be associated with Evaluation Types.

Why can't a user sign the evaluation?

The user must be included in the personnel assignment configured for that signature requirement.

Why can't a user see the evaluation in their list?

The user may not be included in the Assigned Evaluators configuration.

Does adding Critical Fails create automatic checklist failures?

No. Critical Fails entered in the configuration section are informational only. Actual checklist fail conditions are configured during checklist creation.

Can I create custom short codes?

Yes. Disable Auto Generate and manually enter the desired short code.

Do I have to assign evaluators?

No. Assigned Evaluators is optional. If left blank, evaluation availability may be broader depending on user permissions.