Skip to main content

Agent · Backlog

AI Governance & Fairness Testing Agent

Maintains the insurer's AI Systems inventory and evidence required by the NAIC AI Model Bulletin and state rules: pre-deployment and ongoing fairness tests, drift monitoring, vendor documentation and complaint linkage, producing exam-ready artifacts.

Not yet specifiedAssistiveComplexity: Medium
This agent is in the backlog. Registered interest decides which agents are specified and prototyped next.

What it does

  • Maintain inventory of AI systems (including vendor models) with owners and decision impact
  • Run disparate-impact, proxy-variable and calibration tests by protected class before and after deployment
  • Monitor drift and vendor model updates
  • Collect vendor documentation and audit-rights evidence
  • Link consumer complaints to AI-influenced decisions and assemble examiner packages

Systems and data it works with

  • Model governance/observability platforms (e.g., Openlayer)
  • Decision logs from PAS/claims/underwriting agents
  • GRC systems
  • Complaint management
  • NAIC AI Systems Evaluation Tool