QA/QI AI Powered Comments

QA/QI AI Powered Comments

Purpose Statement

The QA/QI AI Powered Comments feature leverages artificial intelligence to automatically analyze EMS incident reports against your agency's protocols, generating relevant quality assurance observations and suggestions. This feature streamlines the QA/QI review process by identifying potential protocol deviations, documentation gaps, and compliance issues, allowing reviewers to focus on critical analysis rather than manual report scanning.

Background Information

AI Powered Comments represents an evolution in quality assurance workflows for EMS agencies. By automatically comparing incident documentation against uploaded agency protocols, the system can identify discrepancies, missing information, and areas requiring additional review. This feature is particularly valuable for agencies managing high call volumes or seeking to standardize their QA/QI processes.
Prerequisites:
  • Agency protocols must be uploaded to First Due 
  • User must have appropriate permissions to access EMS QA/QI module
  • Incidents must be documented in the system for AI analysis

Required Permissions

To utilize QA/QI AI Powered Comments, users must have:

  • EMS QA/QI Module Saved View - Ability to create and modify custom views within the QA/QI module
  • List All QA/QI Ems Incidents - Permission to view and interact with the QA/QI interface

Note: Consult with your system administrator if you're uncertain about your permission levels.


Video



Step-by-Step Guide

Setting Up AI Comments View


Step 1: Access the EMS QA/QI Module
  1. Navigate to Incident Documentation and select EMS QA/QI from the menu





Step 2: Create a New View
  • Select the vertical ellipsis (three dots) icon
  • Click +Add View to begin building a custom view that includes AI Comments





Step 3: Name Your View
  • Enter a descriptive name for your view (e.g., "AI-Assisted QA Review" or "Protocol Compliance Check")


Give this view a Name



Step 4: Add the AI Comments Column
  • Scroll through the available columns list to the bottom
  • Select AI Comments
  • Select any additional columns you wish to include in this view


From the available columns scroll to the bottom and select AI Comments.



Step 5: Configure Selected Columns
  • Click the right arrow to move selected columns from "Available Columns" to "Selected Columns"
  • Use the drag icon next to each column to rearrange the display order according to your preference


By selecting the right arrow will move them to the selected columns.



Step 6: Set Column Sorting
  • Use the Sort by field to select your primary sorting column
  • Optionally, use the Then by field to establish a secondary sort
  • Click the arrow icon next to each sort option to toggle between ascending and descending order


You are able to sort the selected columns using the Sort by field and select the column you wish to have sorted.



Step 7: Configure View Filters
  • Use the Allow filtering by field to add filterable columns
  • Begin typing to see a populated list that filters as you type
  • Select the filters you wish to make available for this view


Set filters for you new view using the Allow filtering by field.



Step 8: Set Filter Criteria - Choose Field
  • Select a field from the dropdown menu to establish the first criterion for your view


You can set criteria for this view by first choosing a field from the dropdown.



Step 9: Set Filter Criteria - Choose Operator
  • Select the appropriate operator from the dropdown:
    • Equal = Single select, must equal the value selected
    • Not Equal = Single select, must not equal the value selected
    • In = Multi-select, must be in the values selected
    • Not In = Multi-select, must not be in the values selected
    • Is Null = Must be empty
    • Is Not Null = Must not be empty


Set the Operator using the dropdown field.



Step 10: Set Filter Criteria - Choose Value
  • Select a value from the dropdown menu
  • Note: Available values will vary based on the field selected in Step 8


Then select a value using the dropdown.



Step 11: Add Additional Criteria (Optional)
  • Click the +Add Criteria button to include additional filtering conditions
  • Note the AND/OR logic:
    • AND = All criteria must be met
    • OR = Only one criterion needs to be met





Step 12: Configure View Sharing
  • Choose who can access this view:
    • Only Me = Only you can view this configuration
    • Everyone = Anyone with EMS QA/QI access can view
    • Selected Users = Choose specific users who can access this view
  • Enable "Allow other users to apply changes to this view" if you want shared users to be able to edit the view configuration


Share this view with



Step 13: Set Default Pagination
  • Select your preferred number of records to display per page


Set a default pagination



Step 14: Save Your View
  • Click Save to finalize your custom view configuration


When completed select Save.



Using AI Powered Comments


Step 15: Access Your Custom View
  • Click the arrow icon to expand the views list and locate your newly created view
  • Use the star icon to mark it as a favorite or the thumbtack icon to pin it to the top of your views list


To access you newly created view, use the arrow to expand the views list and located the newly added view.



Step 16: Review AI Comments in Your View
  • Your custom view will now display the AI Comments column alongside all other selected columns
  • AI-generated observations will appear for each incident in the list


Now you will see in the view created the AI Comments column along with all columns selected.



Step 17: Expand AI Comment Details
  • Click Show More within the AI Comments column to display all comments generated by the AI for that specific incident


By selecting the Show More within the AI Column will display all comments generated by AI



Step 18: Access AI Notes During QA/QI Review
  • When performing a QA/QI review of an individual report, locate the Comments section
  • The AI Notes field contains generated observations for the incident





Step 19: Expand AI Comments in Report View
  • Click the arrow icon to expand and view the full AI Comments within the incident review interface


Using the arrow will expand the AI Comments



Step 20: Remove Irrelevant AI Comments
  • If an AI comment is not applicable or accurate, click the trashcan icon to remove it from the QA/QI record





Step 21: Confirm AI Comment Deletion
  • A modal window will appear asking you to indicate the reason(s) for removing the comment
  • Select the appropriate reason(s)
  • Click Delete AI Review to confirm removal


After selecting the Trashcan icon a modal will display, please indicate a reason or reasons for removing the comment the select Delete AI Review.


Best Practices

Do:
  • Review AI-generated comments as a starting point, not as definitive assessments
  • Use AI comments to identify patterns across multiple incidents
  • Provide feedback by removing inaccurate comments with appropriate reasoning
  • Combine AI observations with your clinical expertise and local protocols
  • Regularly update your agency protocols in the system to ensure accurate AI analysis
  • Create multiple custom views for different QA/QI purposes (compliance, training opportunities, critical cases)
  • Share useful views with your QA/QI team to maintain consistency
Don't:
  • Rely solely on AI comments without independent review
  • Ignore AI comments without consideration—they may identify legitimate concerns
  • Delete AI comments without documenting your reasoning
  • Use outdated or incomplete protocol uploads
  • Assume AI comments replace the need for qualified clinical reviewers
  • Share views containing sensitive filtering criteria with unauthorized users
Common Mistakes to Avoid:
  • Forgetting to include the AI Comments column when creating custom views
  • Not setting appropriate filters, resulting in overwhelming amounts of data
  • Failing to save view configurations before exiting
  • Overlooking the "Show More" option and missing complete AI analysis
  • Removing AI comments without proper documentation of reasoning

Troubleshooting & FAQs

Q: I don't see any AI Comments appearing in my view. What's wrong?
  1. A: Verify that: (1) Your agency protocols have been uploaded to First Due, (2) The AI Comments column is included in your selected columns, (3) The incidents you're reviewing have been processed by the AI system (recently submitted reports may take time to analyze).
Q: The AI Comments seem inaccurate or irrelevant. What should I do?
  1. A: Use the trashcan icon to remove inaccurate comments and document your reasoning. This feedback helps improve the AI system over time. Also verify that your uploaded protocols are current and complete.
Q: Can I customize which types of AI comments appear?
  1. A: Currently, AI comments are generated automatically based on protocol analysis. However, you can use view filters to focus on incidents with specific characteristics or timeframes.
Q: How long does it take for AI comments to appear after an incident is documented?
  1. A: Processing time varies, but most AI comments are generated within minutes of incident submission. Refresh your view if comments don't appear immediately.
Q: Can field personnel see AI comments on their reports?
  1. A: Once a report is completed they can review AI comments within the ePCR, found in the comments area.
Q: What happens when I delete an AI comment?
  1. A: The comment is removed from that incident's QA/QI record, and your documented reason for removal is logged. This helps train the system and provides an audit trail.
Q: How do I update our protocols to improve AI accuracy?
  1. A: Contact your system administrator or refer to the protocols upload documentation. Regular protocol updates ensure AI analysis remains accurate and relevant.


    • Related Articles

    • Performing a QA/QI Review

      Purpose Statement The EMS QA/QI Review Process enables supervisors and quality assurance reviewers to systematically evaluate patient care reports for accuracy, completeness, and compliance with organizational standards. This structured workflow ...
    • Resolving QA/QI comments - Crew Members

      Purpose Statement This article demonstrates the process for resolving QA/QI comments from the perspective of the ePCR report author, ensuring proper response to reviewer feedback and maintaining quality documentation standards. Background Information ...
    • Configuring EMS QA/QI

      Purpose Statement To explain how to set up a process that automatically moves an ePCR onto the "Reports to Review" List, enabling systematic quality assurance and quality improvement review of EMS incidents. This feature helps agencies maintain ...
    • Fire Incident Setup - General - Enabling QA/QI email notifications

      Purpose The purpose of this article to is explain how to enable your Quality Assurance / Quality Improvements within fire incident documentation. Video Directions 1. From the Fire Incident Setup within Incident Documentation select the General ...
    • AI-Powered NFIRS Documentation Guide

      Purpose To provide useful information when using AI for Fire Documentation. Featured Article For full guide select on the Attachment at bottom of the page. FirstDue AI-Powered NFIRS Documentation FAQs General Information Q: What is the AI-assisted ...