Purpose Statement
The QA/QI AI Powered Comments feature leverages artificial intelligence to automatically analyze EMS incident reports against your agency's protocols, generating relevant quality assurance observations and suggestions. This feature streamlines the QA/QI review process by identifying potential protocol deviations, documentation gaps, and compliance issues, allowing reviewers to focus on critical analysis rather than manual report scanning.
Background Information
AI Powered Comments represents an evolution in quality assurance workflows for EMS agencies. By automatically comparing incident documentation against uploaded agency protocols, the system can identify discrepancies, missing information, and areas requiring additional review. This feature is particularly valuable for agencies managing high call volumes or seeking to standardize their QA/QI processes.
Prerequisites:
- Agency protocols must be uploaded to First Due
📝
Important Note:
Upload Protocol instructions here: EMS Setup- External Resources
- User must have appropriate permissions to access EMS QA/QI module
- Incidents must be documented in the system for AI analysis
Required Permissions
To utilize QA/QI AI Powered Comments, users must have:
- EMS QA/QI Module Saved View - Ability to create and modify custom views within the QA/QI module
- List All QA/QI Ems Incidents - Permission to view and interact with the QA/QI interface
Note: Consult with your system administrator if you're uncertain about your permission levels.
Video
Step-by-Step Guide
Setting Up AI Comments View
Step 1: Access the EMS QA/QI Module
- Navigate to Incident Documentation and select EMS QA/QI from the menu

Step 2: Create a New View
- Select the vertical ellipsis (three dots) icon
- Click +Add View to begin building a custom view that includes AI Comments

Step 3: Name Your View
- Enter a descriptive name for your view (e.g., "AI-Assisted QA Review" or "Protocol Compliance Check")

Step 4: Add the AI Comments Column
- Scroll through the available columns list to the bottom
- Select AI Comments
- Select any additional columns you wish to include in this view

Step 5: Configure Selected Columns
- Click the right arrow to move selected columns from "Available Columns" to "Selected Columns"
- Use the drag icon next to each column to rearrange the display order according to your preference

Step 6: Set Column Sorting
- Use the Sort by field to select your primary sorting column
- Optionally, use the Then by field to establish a secondary sort
- Click the arrow icon next to each sort option to toggle between ascending and descending order

Step 7: Configure View Filters
- Use the Allow filtering by field to add filterable columns
- Begin typing to see a populated list that filters as you type
- Select the filters you wish to make available for this view

Step 8: Set Filter Criteria - Choose Field
- Select a field from the dropdown menu to establish the first criterion for your view

Step 9: Set Filter Criteria - Choose Operator
-
Select the appropriate operator from the dropdown:
- Equal = Single select, must equal the value selected
- Not Equal = Single select, must not equal the value selected
- In = Multi-select, must be in the values selected
- Not In = Multi-select, must not be in the values selected
- Is Null = Must be empty
- Is Not Null = Must not be empty

Step 10: Set Filter Criteria - Choose Value
- Select a value from the dropdown menu
- Note: Available values will vary based on the field selected in Step 8

Step 11: Add Additional Criteria (Optional)
- Click the +Add Criteria button to include additional filtering conditions
-
Note the AND/OR logic:
- AND = All criteria must be met
- OR = Only one criterion needs to be met

Step 12: Configure View Sharing
-
Choose who can access this view:
- Only Me = Only you can view this configuration
- Everyone = Anyone with EMS QA/QI access can view
- Selected Users = Choose specific users who can access this view
- Enable "Allow other users to apply changes to this view" if you want shared users to be able to edit the view configuration

Step 13: Set Default Pagination
- Select your preferred number of records to display per page

Step 14: Save Your View
- Click Save to finalize your custom view configuration

Using AI Powered Comments
Step 15: Access Your Custom View
- Click the arrow icon to expand the views list and locate your newly created view
- Use the star icon to mark it as a favorite or the thumbtack icon to pin it to the top of your views list

Step 16: Review AI Comments in Your View
- Your custom view will now display the AI Comments column alongside all other selected columns
- AI-generated observations will appear for each incident in the list

Step 17: Expand AI Comment Details
- Click Show More within the AI Comments column to display all comments generated by the AI for that specific incident

Step 18: Access AI Notes During QA/QI Review
- When performing a QA/QI review of an individual report, locate the Comments section
- The AI Notes field contains generated observations for the incident

Step 19: Expand AI Comments in Report View
- Click the arrow icon to expand and view the full AI Comments within the incident review interface

Step 20: Remove Irrelevant AI Comments
- If an AI comment is not applicable or accurate, click the trashcan icon to remove it from the QA/QI record

Step 21: Confirm AI Comment Deletion
- A modal window will appear asking you to indicate the reason(s) for removing the comment
- Select the appropriate reason(s)
- Click Delete AI Review to confirm removal

Best Practices
Do:
- Review AI-generated comments as a starting point, not as definitive assessments
- Use AI comments to identify patterns across multiple incidents
- Provide feedback by removing inaccurate comments with appropriate reasoning
- Combine AI observations with your clinical expertise and local protocols
- Regularly update your agency protocols in the system to ensure accurate AI analysis
- Create multiple custom views for different QA/QI purposes (compliance, training opportunities, critical cases)
- Share useful views with your QA/QI team to maintain consistency
Don't:
- Rely solely on AI comments without independent review
- Ignore AI comments without consideration—they may identify legitimate concerns
- Delete AI comments without documenting your reasoning
- Use outdated or incomplete protocol uploads
- Assume AI comments replace the need for qualified clinical reviewers
- Share views containing sensitive filtering criteria with unauthorized users
Common Mistakes to Avoid:
- Forgetting to include the AI Comments column when creating custom views
- Not setting appropriate filters, resulting in overwhelming amounts of data
- Failing to save view configurations before exiting
- Overlooking the "Show More" option and missing complete AI analysis
- Removing AI comments without proper documentation of reasoning
Troubleshooting & FAQs
Q: I don't see any AI Comments appearing in my view. What's wrong?
- A: Verify that: (1) Your agency protocols have been uploaded to First Due, (2) The AI Comments column is included in your selected columns, (3) The incidents you're reviewing have been processed by the AI system (recently submitted reports may take time to analyze).
Q: The AI Comments seem inaccurate or irrelevant. What should I do?
- A: Use the trashcan icon to remove inaccurate comments and document your reasoning. This feedback helps improve the AI system over time. Also verify that your uploaded protocols are current and complete.
Q: Can I customize which types of AI comments appear?
- A: Currently, AI comments are generated automatically based on protocol analysis. However, you can use view filters to focus on incidents with specific characteristics or timeframes.
Q: How long does it take for AI comments to appear after an incident is documented?
- A: Processing time varies, but most AI comments are generated within minutes of incident submission. Refresh your view if comments don't appear immediately.
Q: Can field personnel see AI comments on their reports?
- A: Once a report is completed they can review AI comments within the ePCR, found in the comments area.
Q: What happens when I delete an AI comment?
- A: The comment is removed from that incident's QA/QI record, and your documented reason for removal is logged. This helps train the system and provides an audit trail.
Q: How do I update our protocols to improve AI accuracy?
- A: Contact your system administrator or refer to the protocols upload documentation. Regular protocol updates ensure AI analysis remains accurate and relevant.