CFPB AI Supervision: What Examiners Look for in Credit AI Systems
CFPB examiners examining credit AI systems under ECOA, FCRA, and UDAP request documentation in five categories: adverse action records with per-decision reason codes, fair lending disparate impact testing, model documentation including development rationale and validation, training data sources and preprocessing, and human oversight evidence including override rates. This guide maps each CFPB exam request category to the documentation credit AI teams must prepare — and explains the seven most common examination findings.
CFPB Exam Request Category 1: Adverse Action Documentation
CFPB examiners request all adverse action notices and supporting documentation for a sample of AI-denied credit applications. Required records for each adverse decision: the adverse action notice sent to the applicant with specific reason codes, the per-decision feature attribution or reason code basis at decision time, model output and confidence at decision time, model version active at decision time, and any human review record. The most common adverse action finding: reason codes that are generic ("based on information in your application") rather than specific to this applicant ("debt-to-income ratio exceeded threshold"). The CFPB 2022 circular confirmed AI model complexity does not excuse failure to provide specific reasons. Reason codes must be captured at decision time — re-running a current model on historical applications produces different outputs and does not satisfy the original adverse action obligation.
CFPB Exam Request Category 2: Fair Lending Testing
CFPB fair lending examiners request disparate impact analysis, proxy variable documentation, and remediation records. Required materials: disparate impact analysis by protected class (race, sex, national origin, marital status, age) showing approval rate differentials; complete feature list with identification of potential proxy variables and business justification; training data demographic composition and known limitations; model change timeline with fair lending re-evaluation at each change; and remediation documentation for any identified disparate impact. Examiners apply a burden-shifting framework: if the statistical pattern shows disparate impact, the creditor must demonstrate business necessity and the absence of a less discriminatory alternative. Documentation must show the testing was done prospectively, not assembled in response to the examination.
CFPB Exam Request Category 3: Model Documentation
CFPB model documentation requests overlap significantly with SR 11-7 requirements and EU AI Act Annex IV. Required materials: model inventory entry showing this model is in scope for MRM; development documentation covering purpose, methodology, data sources, and known limitations; independent validation reports; change management records showing each model update with validation status; and use limitation documentation defining what decisions this model is authorized to make. The most common model documentation finding: no formal development documentation for models "inherited" from prior versions or transferred from a vendor. If a model is in production making credit decisions, it needs current development documentation — vendor documentation may not satisfy CFPB expectations for creditor-level accountability.
CFPB Exam Request Category 4: Training Data Records
CFPB training data requests focus on FCRA compliance, data quality, and demographic representation. Required materials: training data sources with documentation of FCRA compliance for any consumer report data used in training; demographic composition of training data; data preprocessing steps including exclusions and transformations; known data quality limitations and how they were addressed; and ongoing data quality monitoring documentation. FCRA compliance for training data is frequently overlooked: consumer report data used in AI training requires permissible purpose, and the permissible purpose for training may differ from the permissible purpose for operational use. Examiners have flagged use of credit bureau data for model training where permissible purpose was unclear.
CFPB Exam Request Category 5: Human Oversight Evidence
CFPB examiners request evidence that human oversight is genuine rather than nominal. Required materials: documented human review process with reviewer qualifications and authority to override AI decisions; override rate data showing actual review rates (not just process documentation); escalation criteria defining when human review is triggered; audit trail records linking AI decisions to human review outcomes; and consumer rights documentation showing how consumers can request human review of adverse decisions. The most common human oversight finding: review rates that are nominally compliant but practically zero — a process that exists on paper but is bypassed in operations. Examiners have required remediation plans when override rates suggest human reviewers are routinely ratifying AI decisions without genuine review.